-- Logs begin at Thu 2022-08-18 15:54:06 UTC, end at Thu 2022-08-18 17:42:14 UTC. -- Aug 18 17:03:43.853624 dv-cinder-853679-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 17:03:43.863620 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 17:03:43 2022] *** Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: nodename: dv-cinder-853679-1-iscsi Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: machine: x86_64 Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: clock source: unix Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: pcre jit disabled Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: detected number of CPU cores: 4 Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: current working directory: / Aug 18 17:03:43.865282 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: detected binary path: /usr/bin/uwsgi-core Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: your processes number limit is 47680 Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: your memory page size is 4096 bytes Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: detected max file descriptor number: 2048 Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: lock engine: pthread robust mutexes Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: thunder lock: enabled Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 17:03:43.865966 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 17:03:43.905101 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: Python main interpreter initialized at 0x55f1b63ed9c0 Aug 18 17:03:43.905101 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: python threads support enabled Aug 18 17:03:43.905101 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: your server socket listen backlog is limited to 100 connections Aug 18 17:03:43.905101 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: your mercy for graceful operations on workers is 90 seconds Aug 18 17:03:43.905430 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 17:03:43.905524 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: *** Operational MODE: preforking *** Aug 18 17:03:43.905760 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: *** uWSGI is running in multiple interpreter mode *** Aug 18 17:03:43.905760 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: spawned uWSGI master process (pid: 106106) Aug 18 17:03:43.905956 dv-cinder-853679-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 17:03:43.907773 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: spawned uWSGI worker 1 (pid: 106107, cores: 1) Aug 18 17:03:43.907773 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: spawned uWSGI worker 2 (pid: 106108, cores: 1) Aug 18 17:03:43.907773 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 17:03:44.562875 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 17:03:44.568326 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 17:03:45.651185 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:03:45.651185 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: from cryptography.utils import int_from_bytes Aug 18 17:03:45.651779 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:03:45.651779 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: from cryptography.utils import int_from_bytes Aug 18 17:03:45.651918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:03:45.651918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: from cryptography.utils import int_from_bytes Aug 18 17:03:45.651918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:03:45.651918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: from cryptography.utils import int_from_bytes Aug 18 17:03:48.153066 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 17:03:48.153750 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 17:03:48.154102 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 17:03:48.154198 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 17:03:48.154280 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 17:03:48.154357 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 17:03:48.154433 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 17:03:48.154511 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 17:03:48.154587 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 17:03:48.154739 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 17:03:48.154819 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.154894 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.155141 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.155245 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.155461 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.155567 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.155779 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.155874 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.156111 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.156209 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.156421 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.156517 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.156735 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.156830 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.157056 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.157161 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.157476 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.157568 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.157796 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.157955 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.158109 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.158335 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.158442 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853679-1-iscsi {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.158662 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853679-1-iscsi {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.158752 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159023 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159142 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159336 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159421 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159644 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159731 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.159957 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.160051 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.160258 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.160351 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.160569 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.160661 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.160869 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.161075 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.161366 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.161670 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.161971 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.162334 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.162562 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.162657 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.162890 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163008 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163227 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163319 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163542 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163673 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163846 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.163934 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.164161 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.164257 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.164462 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.164558 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.164800 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.164893 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853679-1-iscsi {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.165129 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.165216 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.165449 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.165544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.165757 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.165853 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853679-1-iscsi {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.166148 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.166236 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.166450 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.166550 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.166755 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.166842 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.167108 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.167220 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.167423 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.167511 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.167726 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.167812 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168044 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168144 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168358 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168456 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168669 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168764 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.168983 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169080 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169281 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169367 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169585 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169671 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169883 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.169970 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.170196 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.170293 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.170494 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.170592 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.170790 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.170876 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171062 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171152 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171367 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171463 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171683 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171776 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.171976 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.172060 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.172285 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.172380 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.172532 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.172618 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.172778 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.173435 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.173759 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.173873 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174014 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174216 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174304 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174530 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174617 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174841 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.174965 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.175178 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.175264 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.175485 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.175621 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.175794 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.175903 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.176099 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.176192 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.176401 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.176497 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.176704 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.176794 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177008 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177096 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177316 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177406 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177636 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177728 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.177937 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.178034 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.178250 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.178355 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.178560 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.178659 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.178875 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179040 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179203 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179292 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179534 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179621 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179844 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.179938 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.180152 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.180246 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.180457 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.180543 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.180772 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.180872 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181075 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181166 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181375 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181460 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181677 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181774 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.181983 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182070 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182292 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182380 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182592 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182677 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182838 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.182975 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.183161 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.183260 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.183460 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.183557 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.183799 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.183892 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184068 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184164 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184368 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184455 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184668 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184753 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.184961 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.185061 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.185262 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.185348 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.185559 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.185643 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.185912 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186028 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186150 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186237 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186447 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186533 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186744 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.186839 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187068 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187157 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187369 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187459 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187672 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187773 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.187977 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.188065 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.188282 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.188375 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.189174 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.189371 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.189497 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.189808 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.189904 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.190118 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.190213 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.190425 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.190520 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.190732 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.190819 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191061 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191148 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191371 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191466 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191677 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191761 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.191985 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192069 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192289 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192376 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192592 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192676 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192896 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.192986 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.193198 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.193285 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.193503 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.193593 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.193799 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.193939 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.194102 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.194188 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.194407 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.194504 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.194706 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.194798 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195037 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195126 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195329 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195428 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195626 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195724 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.195924 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196074 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196225 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196309 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196518 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196611 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196815 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.196908 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.197108 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.197200 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.197407 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.197505 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.197723 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.197812 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198025 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198109 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198328 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198415 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198626 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198712 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.198947 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.199035 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.199274 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:03:48.199368 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.199597 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.199683 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.199928 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.200013 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.200506 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.200599 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.200835 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.200920 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.201160 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.201255 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.201473 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.201559 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.201778 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.201871 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.202084 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.202182 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.202398 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.202482 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.202703 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.202794 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203033 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203138 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203341 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203466 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203734 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.203966 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.204095 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.204327 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.204528 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.204660 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.204980 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.205066 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.205299 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.205393 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.205617 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.205702 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.205930 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.206074 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.206251 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.206347 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.206577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.206676 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.206893 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.207050 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.207229 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.207324 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.207564 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.207648 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.207906 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208003 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208214 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208315 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208534 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208628 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208849 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.208948 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.209155 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.209249 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.209461 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.209554 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.209766 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.209853 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.210081 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.210175 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.210406 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.210493 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.210714 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.210801 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211052 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211142 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211362 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211448 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211671 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211759 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.211976 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.212062 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.212281 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.212367 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.212588 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.212676 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.212918 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213007 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213230 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213316 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213538 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213626 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213849 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.213942 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.214166 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.214267 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.214472 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.214556 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.214778 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.214871 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.215110 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.215207 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.215410 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.215504 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.215710 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.215803 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216010 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216152 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216315 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216407 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216613 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216706 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.216925 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217020 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217245 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217338 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217631 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217874 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.217967 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.218174 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.218265 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.218481 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.218574 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.218785 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.218878 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.219117 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.219204 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.219417 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.219553 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.220275 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.220375 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.220732 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.220817 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.221049 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.221326 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.221422 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.221681 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.221887 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.221973 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.222206 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.222300 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.222516 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.222602 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.222840 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.222958 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.223175 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.223271 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.223481 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.223574 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.223794 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.223881 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.224110 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.224233 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.224421 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.224522 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.224730 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.224824 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225038 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225138 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225352 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225436 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225659 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225750 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.225967 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.226054 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.226297 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.226381 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.226619 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.226711 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.226939 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227029 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227262 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227350 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227565 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227650 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227879 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.227970 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.228183 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.228267 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.228488 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.228573 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.228786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.228872 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229088 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229183 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229390 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229485 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229698 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229790 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.229995 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.230080 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.230292 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.230387 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.230591 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.230677 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.230889 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231019 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231210 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231309 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231523 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231607 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231826 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.231910 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.232127 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.232223 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.232427 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.232513 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.232725 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.232810 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.233061 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.233151 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.233359 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.233445 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.233692 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.233777 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234020 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234107 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234332 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234419 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234648 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234734 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.234981 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.235070 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.235317 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.235435 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.236148 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.236457 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.236552 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.236855 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.236947 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.237171 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.237257 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.237485 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.237572 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.237807 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.237892 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.238117 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.238204 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.238439 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.238527 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.238750 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.238834 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.239082 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.239181 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.239397 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.239483 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.239713 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.239799 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240016 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240110 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240328 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240415 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240662 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240747 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.240979 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241065 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241294 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241389 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241601 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241686 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241904 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.241999 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.242213 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.242300 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.242519 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.242605 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.242826 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.242954 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.243157 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.243251 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.243464 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.243549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.243776 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.243873 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.244079 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.244165 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.244390 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.244488 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.244696 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.244792 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245002 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245086 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245309 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245395 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245623 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245718 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.245923 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.246009 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.246231 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.246319 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.246549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.246635 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.246871 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247007 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247202 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247292 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247509 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247610 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247819 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.247913 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.248124 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.248209 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.248429 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.248516 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.248733 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.248820 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249032 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249128 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249334 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249420 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249637 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249733 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.249943 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250036 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250245 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250331 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250549 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250636 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250848 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.250983 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.251225 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.251387 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.251540 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.251794 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.251887 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.252103 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.252198 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.252407 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.252531 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.252719 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.252812 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253039 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253128 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253348 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253441 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253667 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253760 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.253978 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.254074 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.254278 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.254406 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.254580 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.254680 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.254880 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255017 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255217 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255314 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255518 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255614 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255819 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.255912 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.256119 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.256212 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.256444 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.256577 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.256749 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.256837 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257048 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257135 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257357 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257445 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257666 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257751 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.257968 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.258097 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.258286 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.258374 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.258591 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.258677 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.258915 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259005 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259233 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259328 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259540 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259627 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259844 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.259929 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.260149 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.260236 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.260456 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.260543 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.260760 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.260854 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261065 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261151 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261379 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261465 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261680 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261778 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.261985 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.262071 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.262289 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.262552 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.262683 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.262879 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.262996 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.263220 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.263304 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.263541 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.263773 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.263876 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.264098 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.264184 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.264417 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.264504 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.264721 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.264815 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265034 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265119 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265349 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265444 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265672 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265767 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.265994 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.266079 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.266316 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.266400 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.266665 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.266836 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.266989 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.267232 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.267320 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.267594 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.267677 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.267907 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268001 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268212 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268298 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268520 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268606 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268825 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.268924 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.269127 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.269213 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.269437 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.269523 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.269738 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.269833 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270040 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270126 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270342 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270426 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270639 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270732 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.270972 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271074 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271276 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271362 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271583 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271668 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271882 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.271967 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.272199 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.272284 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.272502 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.272596 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.272801 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.272887 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.273099 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.273185 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.273398 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.273492 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.273734 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.273820 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274033 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274120 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274365 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274452 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274668 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274751 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.274996 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.275102 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.275306 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.275393 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.275616 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.275702 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.275928 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276026 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276225 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276309 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276523 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276614 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276820 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.276918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.277125 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.277211 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.277428 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.277513 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.277727 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.277821 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278035 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278121 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278339 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278432 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278641 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278726 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.278966 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279056 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279268 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279354 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279570 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279658 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279866 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.279960 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.280173 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.280259 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.280476 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.280568 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.280770 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.280853 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281065 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281150 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281369 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281456 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281671 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281756 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.281967 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.282061 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.282835 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.282970 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.283173 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.283390 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.283501 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.283709 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.283797 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284015 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284110 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284316 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284403 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284620 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284708 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.284930 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285016 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285238 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285323 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285539 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285628 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285842 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.285926 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.286153 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.286248 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.286451 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.286544 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.286750 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.286879 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287083 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287257 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287472 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287685 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287780 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.287990 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288083 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288294 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288380 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288603 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288702 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288899 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.288994 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.289199 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.289285 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.289494 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.289578 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.289796 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.289884 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.290094 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.290180 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.290398 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.290500 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.290692 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.290787 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291013 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291103 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291313 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291399 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291611 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291700 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.291911 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292005 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292227 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292325 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292531 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292618 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292827 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.292921 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.293127 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.293225 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.293424 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.293510 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.293759 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.293853 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.294058 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.294153 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.294373 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.294457 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.294680 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.294766 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295016 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295117 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295329 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295420 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295634 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295717 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.295935 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296029 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296240 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296327 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296535 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296623 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296843 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.296929 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.297149 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.297240 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.297453 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.297540 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.297754 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.297893 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.298637 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.298894 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.298996 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.299267 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.299505 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.299594 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.299883 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.300074 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.300194 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.300403 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.300498 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.300728 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.300826 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301052 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301145 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301376 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301475 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301682 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301769 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.301990 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.302074 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.302296 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.302384 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.302602 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.302695 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.302933 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303023 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303236 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303324 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303541 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303633 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303849 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.303936 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.304151 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.304244 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.304455 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.304541 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.304758 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.304852 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305055 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305141 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305359 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305445 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305662 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305787 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.305959 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.306104 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.306274 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.306419 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.306577 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.306728 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.306877 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.307066 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.307206 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.307380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.307506 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.307698 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.307810 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.308015 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.308103 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.308324 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.308515 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.308743 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.308840 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309057 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309150 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309371 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309465 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309777 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.309992 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.310113 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.310297 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.310395 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.310603 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.310692 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.310957 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311060 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311243 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311337 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311551 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311637 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311855 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.311941 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.312177 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.312275 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.312484 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.312571 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.312792 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.312887 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.313099 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.313232 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.313458 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.313612 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.313828 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.313923 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.314285 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.314385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.314554 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.314671 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.314867 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.315018 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.315213 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.315324 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.315535 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.315643 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.315858 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.316054 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.316148 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.316363 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.316449 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.316666 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.316752 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317071 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317199 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317378 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317465 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317684 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317779 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.317998 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.318097 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.318304 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.318392 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.318622 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.318707 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.318940 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319030 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319252 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319340 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319557 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319644 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319873 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.319989 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.320191 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.320314 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.320505 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.320637 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.320806 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.320933 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.321105 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.321258 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.321420 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.321567 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.321734 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.321872 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.322040 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.322183 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.322356 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.322488 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.322761 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.322857 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.323102 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.323189 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.323410 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.323511 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.323722 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.323817 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324036 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324122 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324335 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324421 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324634 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324730 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.324936 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.325022 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.325493 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.325586 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.325796 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.325884 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.326112 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.326198 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.326412 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.326506 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.326718 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.326812 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327048 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327151 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327355 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327442 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327638 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327729 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.327936 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328026 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328250 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328346 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328553 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328641 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328858 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.328943 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.329236 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.329340 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.329549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.329785 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.329873 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.330108 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.330195 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.330411 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.330499 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.330729 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.330816 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331069 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331170 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331372 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331467 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331674 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331774 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.331973 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.332069 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.332309 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.332403 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.332609 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.332696 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.332923 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333245 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333332 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333557 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333642 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333860 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.333954 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.334163 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.334248 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.334475 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.334562 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.334779 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.334875 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.335109 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.335198 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.335414 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.335511 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.335714 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.335808 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336015 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336102 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336407 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336620 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336715 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.336923 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337018 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337221 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337307 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337523 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337609 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337819 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.337905 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.338118 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.338204 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.338420 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.338508 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.338737 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.338824 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339073 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339180 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339392 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339480 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339696 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339782 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.339996 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.340096 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.340297 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.340384 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.340597 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.340684 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.340918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341015 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341220 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341315 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341529 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341615 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341834 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.341928 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.342149 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.342234 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.342458 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.342544 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.342770 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343004 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343096 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343341 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343428 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343655 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343756 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.343968 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.344055 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.344284 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.344374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.344585 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.345205 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.345547 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.345624 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.345912 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.346098 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.346187 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.346412 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.346501 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.346783 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.346951 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.347147 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.347294 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.347473 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.347583 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.347798 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.347886 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.348133 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.348229 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.348454 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.348542 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.348771 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.348865 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.349088 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.349184 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.349392 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.349476 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.349697 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.349790 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350004 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350092 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350327 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350421 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350642 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350729 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.350982 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.351072 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.351302 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.351397 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.351615 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.351713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.351923 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352015 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352232 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352317 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352541 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352637 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352851 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.352944 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.353162 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.353248 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.353474 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.353560 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.353784 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.353878 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.354093 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.354178 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.354400 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.354487 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.354705 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.354792 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355032 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355120 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355344 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355432 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355653 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355739 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.355959 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.356172 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.356270 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.356485 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.356571 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.356818 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.356906 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.357144 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.357233 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.357466 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.357560 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.357779 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.357900 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.358088 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.358177 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.358396 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.358483 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.358702 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.358787 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359035 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359238 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359348 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359546 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359665 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359872 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.359960 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.360188 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.360275 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.361117 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.361280 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.361423 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.361715 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.361804 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.362030 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.362117 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.362354 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.362559 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.362647 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.362917 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363068 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363242 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363338 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363559 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363646 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363859 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.363947 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.364175 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.364271 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.364480 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.364565 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.364779 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.364874 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.365092 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.365192 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.365395 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.365480 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.365710 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.365915 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366002 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366296 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366389 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366562 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366650 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366881 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.366992 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.367223 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.367320 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.367524 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.367611 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.367826 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.367930 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.368128 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.368214 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.368430 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.368515 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.368735 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.368830 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369038 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369130 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369339 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369424 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369636 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369734 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.369934 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370022 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370235 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370424 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370537 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370632 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370834 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.370963 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.371165 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.371252 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.371463 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.371551 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.371768 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.371868 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372070 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372156 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372365 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372451 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372663 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372749 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.372967 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373052 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373263 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373349 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373560 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373647 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373857 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.373951 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.374153 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.374241 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.374456 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.374542 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.374751 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.374845 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.375080 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.375169 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.375378 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.375464 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.375682 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.375785 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.376078 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.376168 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.376392 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.376624 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.376993 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.377121 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.377317 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.377462 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.377619 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.377788 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.377962 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.378127 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.378275 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.378463 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.378585 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.378775 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.378924 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.379113 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.379230 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.379425 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.379534 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.379758 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.379858 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.380073 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.380160 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.380386 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.380685 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.380772 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.380998 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.381092 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.381312 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.381398 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.381625 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.381720 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.381939 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382034 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382324 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382540 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382638 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382841 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.382944 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.383174 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.383260 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.383484 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.383581 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.383789 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.383876 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.384097 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.384187 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.384401 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.384499 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.384707 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.384793 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385010 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385097 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385317 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385411 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385622 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385716 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.385925 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386018 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386230 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386317 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386533 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386619 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386836 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.386962 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.387173 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.387268 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.387476 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.387563 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.387783 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.387882 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.388111 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.388241 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.388416 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.388504 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.388731 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.388830 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389042 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389136 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389355 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389441 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389660 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389755 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.389965 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390052 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390267 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390353 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390571 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390658 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390883 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.390988 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.391230 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.391320 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.391573 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.391684 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.391931 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.392102 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.392364 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.392530 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.392700 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.392841 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393027 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393157 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393337 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393473 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393644 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393777 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.393949 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.394093 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.394261 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.394408 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.394581 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.394714 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.394892 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.395054 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.395218 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.395362 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.395524 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.395684 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.395833 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396015 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396135 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396337 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396426 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396656 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396744 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.396955 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397051 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397255 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397341 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397556 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397643 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397860 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.397964 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.398171 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.398256 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.398472 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.398558 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.398769 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.398863 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399093 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399180 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399397 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399483 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399695 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399783 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.399991 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400078 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400286 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400372 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400583 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400671 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400885 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.400972 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.401177 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.401270 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.401472 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.401560 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.401768 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.401854 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402062 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402148 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402357 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402444 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402653 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402740 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.402979 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403126 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403277 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403365 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403597 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403698 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403872 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.403968 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.404167 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.404277 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.404461 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.404608 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.404784 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.404919 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.405107 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.405230 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.405414 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.405542 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.405729 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.405852 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406030 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406162 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406342 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406472 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406643 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406796 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.406986 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.407147 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.407940 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.408067 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.408400 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.408544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.408721 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.408809 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409046 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409133 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409365 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409454 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409685 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409777 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.409993 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.410080 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.410300 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.410390 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.410606 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.410701 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.410940 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411047 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411239 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411326 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411552 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411691 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411858 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.411958 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.412170 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.412255 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.412479 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.412565 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.412793 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.412879 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.413101 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.413186 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.413407 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.413494 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.413728 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.413817 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414033 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414120 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414338 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414425 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414641 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414742 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.414974 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415065 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415283 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415370 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415593 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415682 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415896 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.415983 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.416201 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.416403 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.416498 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.416578 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.416806 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.416901 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.417101 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 17:03:48.417196 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.417433 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.417738 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.418057 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.418376 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.418721 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.419058 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.419399 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.419722 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.420031 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.420338 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.420637 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:03:48.420876 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 17:03:48.572147 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO dbcounter [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Registered counter for database nova_api Aug 18 17:03:48.577235 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO dbcounter [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Registered counter for database nova_api Aug 18 17:03:48.593814 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_db.sqlalchemy.engines [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.597306 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.600807 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writer thread running {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.603707 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writer thread running {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.657779 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.context [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),baddab50-6834-47ff-9a53-35237c9c57ce(cell1) {{(pid=106108) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 17:03:48.660168 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.context [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),baddab50-6834-47ff-9a53-35237c9c57ce(cell1) {{(pid=106107) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 17:03:48.661581 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:48.662059 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:48.663684 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:48.663965 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_concurrency.lockutils [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:48.664429 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:48.664520 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_concurrency.lockutils [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:48.664876 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:48.665986 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_concurrency.lockutils [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:48.666718 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_concurrency.lockutils [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:48.666871 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:48.667196 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_concurrency.lockutils [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:48.668838 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO dbcounter [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Registered counter for database nova_cell0 Aug 18 17:03:48.669149 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_concurrency.lockutils [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:48.671135 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO dbcounter [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Registered counter for database nova_cell0 Aug 18 17:03:48.674802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO dbcounter [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Registered counter for database nova_cell1 Aug 18 17:03:48.677215 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO dbcounter [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Registered counter for database nova_cell1 Aug 18 17:03:48.682214 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_db.sqlalchemy.engines [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.684068 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_db.sqlalchemy.engines [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.685192 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.687468 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.689891 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writer thread running {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.695491 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writer thread running {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.696970 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writer thread running {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.831770 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writer thread running {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.841510 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO dbcounter [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Registered counter for database nova_cell0 Aug 18 17:03:48.843515 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO dbcounter [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Registered counter for database nova_cell0 Aug 18 17:03:48.848875 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_db.sqlalchemy.engines [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.852462 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:03:48.853305 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writer thread running {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:48.857028 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writer thread running {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:03:49.328116 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: WARNING keystonemiddleware.auth_token [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:03:49.335942 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: WARNING keystonemiddleware.auth_token [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:03:49.466316 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: WARNING keystonemiddleware.auth_token [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:03:49.474374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: WARNING keystonemiddleware.auth_token [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:03:49.676786 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: WARNING keystonemiddleware.auth_token [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:03:49.682984 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: WARNING keystonemiddleware.auth_token [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:03:49.688458 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1b63ed9c0 pid: 106108 (default app) Aug 18 17:03:49.691302 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:49.692519 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] 10.222.0.82 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001943 Aug 18 17:03:49.692958 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 788 bytes} [Thu Aug 18 17:03:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:03:49.826424 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: WARNING keystonemiddleware.auth_token [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:03:49.832581 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: WARNING keystonemiddleware.auth_token [None req-7cf2ec4f-0b87-4bb0-982a-73c779ee95c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:03:49.837806 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1b63ed9c0 pid: 106107 (default app) Aug 18 17:05:10.318120 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:10.319281 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 18 17:05:10.319794 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 2/2] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:10.334871 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_api:SELECT=3 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:10.342195 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_cell0:SELECT=3 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:10.343937 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_cell1:SELECT=3 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:10.344928 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:11.202134 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-90f71cf8-68c6-41ad-9b4c-7507fe184031 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:11.234770 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-90f71cf8-68c6-41ad-9b4c-7507fe184031 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907122 Aug 18 17:05:11.235576 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 1/3] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 17:05:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:13.584732 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:13.585702 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-f370ead8-16e3-4ddc-bca5-5d211c9918de None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001381 Aug 18 17:05:13.586344 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 3/4] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:14.025071 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-b6edec8f-51a3-4fb4-9b3a-a43e8d592ed2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "ram": 256, "id": "c1"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:14.048472 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:05:14.048472 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: warnings.warn(msg) Aug 18 17:05:14.145535 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-b6edec8f-51a3-4fb4-9b3a-a43e8d592ed2 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.536656 Aug 18 17:05:14.146162 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 2/5] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:14.160041 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_api:SELECT=3 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:14.160807 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_cell0:SELECT=3 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:14.161817 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_cell1:SELECT=3 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:14.162788 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:14.374891 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-a67cce65-3be9-4199-aa86-68a45e8636aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:14.379215 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:05:14.379215 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: warnings.warn(msg) Aug 18 17:05:14.503667 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-a67cce65-3be9-4199-aa86-68a45e8636aa admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348577 Aug 18 17:05:14.504167 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 4/6] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 17:05:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:16.857157 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-b6edec8f-51a3-4fb4-9b3a-a43e8d592ed2 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:16.858743 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-b6edec8f-51a3-4fb4-9b3a-a43e8d592ed2 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Aug 18 17:05:16.859178 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 3/7] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:17.542665 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-8128cb70-a283-4f22-8935-c4259c0a7f9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "id": "d1", "ram": 512, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:17.562960 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:05:17.562960 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: warnings.warn(msg) Aug 18 17:05:17.637954 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-8128cb70-a283-4f22-8935-c4259c0a7f9f admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.772635 Aug 18 17:05:17.638640 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 5/8] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:05:17.650441 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-5e572069-2479-4e13-af98-e738603722d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:17.654279 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:05:17.654279 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: warnings.warn(msg) Aug 18 17:05:17.756246 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-5e572069-2479-4e13-af98-e738603722d2 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109294 Aug 18 17:05:17.763590 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 4/9] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 17:05:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:20.115893 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-8128cb70-a283-4f22-8935-c4259c0a7f9f admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:20.116908 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-8128cb70-a283-4f22-8935-c4259c0a7f9f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 18 17:05:20.117317 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 6/10] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:20.514020 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-04d6bc87-fc79-43ad-9275-3cb7a0450fe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:20.562173 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-04d6bc87-fc79-43ad-9275-3cb7a0450fe2 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438225 Aug 18 17:05:20.562723 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 5/11] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:05:20.575917 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-b397f4a4-7269-4b24-91b9-af160e648796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:20.633611 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-b397f4a4-7269-4b24-91b9-af160e648796 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062206 Aug 18 17:05:20.634179 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 7/12] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 17:05:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:23.032837 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-04d6bc87-fc79-43ad-9275-3cb7a0450fe2 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:23.033848 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-04d6bc87-fc79-43ad-9275-3cb7a0450fe2 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 18 17:05:23.034253 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 6/13] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:23.484966 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-0969abe7-4ca5-47fd-9ccb-b09c9b087ba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:23.563502 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-0969abe7-4ca5-47fd-9ccb-b09c9b087ba1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523257 Aug 18 17:05:23.564042 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 8/14] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:05:23.576950 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-5e2f7efc-1e96-4d44-bf6c-56958730fcf6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:23.658986 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-5e2f7efc-1e96-4d44-bf6c-56958730fcf6 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086522 Aug 18 17:05:23.659768 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 7/15] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 17:05:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:26.020100 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-0969abe7-4ca5-47fd-9ccb-b09c9b087ba1 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:26.021060 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-0969abe7-4ca5-47fd-9ccb-b09c9b087ba1 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 18 17:05:26.021451 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 9/16] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:26.447559 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-961438fc-2ca8-4cd3-8949-020f840f1528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:26.534446 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-961438fc-2ca8-4cd3-8949-020f840f1528 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506299 Aug 18 17:05:26.535323 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 8/17] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:26.547280 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-e8484cc3-4966-476f-810b-5655204f9c2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:26.634955 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-e8484cc3-4966-476f-810b-5655204f9c2e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091372 Aug 18 17:05:26.635654 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 10/18] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 17:05:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:29.053974 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-961438fc-2ca8-4cd3-8949-020f840f1528 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:29.055028 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-961438fc-2ca8-4cd3-8949-020f840f1528 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 18 17:05:29.055441 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 9/19] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:29.516392 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-2789444b-d793-41ac-b8cd-f9a8a9fb116c admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:29.541203 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-2789444b-d793-41ac-b8cd-f9a8a9fb116c admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478565 Aug 18 17:05:29.541756 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 11/20] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 17:05:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:05:31.897063 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-961438fc-2ca8-4cd3-8949-020f840f1528 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:31.898075 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-961438fc-2ca8-4cd3-8949-020f840f1528 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 18 17:05:31.898497 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 10/21] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:32.315899 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-54577337-7e86-4e9e-9f4f-33634e339b27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:32.381589 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-54577337-7e86-4e9e-9f4f-33634e339b27 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476135 Aug 18 17:05:32.382228 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 12/22] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:32.395071 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-f26a0889-b9af-4940-8b1f-d47807f9a1b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:32.464010 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-f26a0889-b9af-4940-8b1f-d47807f9a1b2 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072630 Aug 18 17:05:32.464748 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 11/23] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 17:05:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:34.807505 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-54577337-7e86-4e9e-9f4f-33634e339b27 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:34.809732 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-54577337-7e86-4e9e-9f4f-33634e339b27 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002800 Aug 18 17:05:34.810132 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 13/24] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:35.205201 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-2f568990-e53a-4e9d-862b-355ca0e9a55d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:35.276735 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-2f568990-e53a-4e9d-862b-355ca0e9a55d admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460336 Aug 18 17:05:35.277368 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 12/25] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:35.289496 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-80be0d48-6115-423f-b643-2af87da44d2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:35.394956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-80be0d48-6115-423f-b643-2af87da44d2a admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109016 Aug 18 17:05:35.395471 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 14/26] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 17:05:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:37.737517 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-2f568990-e53a-4e9d-862b-355ca0e9a55d admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:37.738527 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-2f568990-e53a-4e9d-862b-355ca0e9a55d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 18 17:05:37.738964 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 13/27] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:38.095374 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-b6fef4f0-7a27-487e-be54-750caf61b7cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:38.212912 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-b6fef4f0-7a27-487e-be54-750caf61b7cc admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.467821 Aug 18 17:05:38.213390 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 15/28] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:38.225520 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a82c08a4-c11b-43ac-a77f-78ce53451438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:38.382850 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a82c08a4-c11b-43ac-a77f-78ce53451438 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160980 Aug 18 17:05:38.383449 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 14/29] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 17:05:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:40.813554 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-b6fef4f0-7a27-487e-be54-750caf61b7cc admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:40.815222 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-b6fef4f0-7a27-487e-be54-750caf61b7cc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Aug 18 17:05:40.815836 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 16/30] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:41.266333 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-cbadf27b-7602-4b04-b301-b55c3a57d52a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "disk": 80}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:41.273160 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:41.322205 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-cbadf27b-7602-4b04-b301-b55c3a57d52a admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.497722 Aug 18 17:05:41.327265 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 15/31] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:41.335231 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-4c419452-8d39-4cfe-9ca2-08869951733f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:41.424838 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-4c419452-8d39-4cfe-9ca2-08869951733f admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093579 Aug 18 17:05:41.435390 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 17/32] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 17:05:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:43.780785 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-cbadf27b-7602-4b04-b301-b55c3a57d52a admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:43.782166 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-cbadf27b-7602-4b04-b301-b55c3a57d52a admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Aug 18 17:05:43.782848 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 16/33] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:44.252395 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-1bef4613-3c17-4184-9dae-1125d7d463f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "ram": 16384, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:44.339306 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-1bef4613-3c17-4184-9dae-1125d7d463f7 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.549982 Aug 18 17:05:44.340690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 18/34] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 17:05:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:05:44.352588 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-6d41e934-feda-4a22-90f7-513bd3a790a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:44.475994 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-6d41e934-feda-4a22-90f7-513bd3a790a7 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120922 Aug 18 17:05:44.475994 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 17/35] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 17:05:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:04.826571 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-1bef4613-3c17-4184-9dae-1125d7d463f7 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:04.827644 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-1bef4613-3c17-4184-9dae-1125d7d463f7 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 18 17:06:04.828052 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 19/36] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:04.838996 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:05.218137 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-1ce2f0da-c4c9-47ab-a67a-843e16e97e2f admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:05.236956 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-1ce2f0da-c4c9-47ab-a67a-843e16e97e2f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402964 Aug 18 17:06:05.237481 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 18/37] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 17:06:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:06.299136 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-1bef4613-3c17-4184-9dae-1125d7d463f7 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.300138 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-1bef4613-3c17-4184-9dae-1125d7d463f7 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 18 17:06:06.300527 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 20/38] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:06.817437 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-4c11b541-8e7e-456d-97e7-95cbef6c80e1 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.823560 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.wsgi [None req-4c11b541-8e7e-456d-97e7-95cbef6c80e1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-4c11b541-8e7e-456d-97e7-95cbef6c80e1 admin admin] Request method failure captured: Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Accept: application/json Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Accept-Encoding: gzip, deflate Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Connection: keep-alive Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Content-Length: 0 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Host: 10.222.0.82 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Openstack-Api-Version: compute 2.90 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Openstack-System-Scope: None Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: User-Agent: python-novaclient Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Auth-Token: gAAAAABi_nF-ryYvnCquFQ3nO0121WlxDdahRC1v1GYNdt4ouBf_X7c8flWyilNE5pEA_wP5t4khbwWi2b6CfDu5nxnNyitO5Pmq_lzOxxwnjvtm9asRw4ACbhVODO4Wd3tNXPI3YTifwXfCSbpbCZXiOI4EgF7eBnAowk6bp2qZoUe9lKPO7G8 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Domain-Id: None Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Domain-Name: None Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Identity-Status: Confirmed Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Is-Admin-Project: True Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Domain-Id: default Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Domain-Name: Default Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Name: admin Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Role: admin,member,reader Aug 18 17:06:06.826786 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Roles: admin,member,reader Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant: admin Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant-Name: admin Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User: admin Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Domain-Id: default Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Domain-Name: Default Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Id: 329c213a845c4ab2a0642e5a7dbd4b18 Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Name: admin Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: method: > Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: exception: Flavor 42 could not be found. Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: action_args: {'id': '42'} Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:06.828374 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:06.829239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.830385 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-4c11b541-8e7e-456d-97e7-95cbef6c80e1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:06.831622 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-4c11b541-8e7e-456d-97e7-95cbef6c80e1 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388554 Aug 18 17:06:06.831622 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 19/39] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:06.838117 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-4f9be7be-4b41-4433-ba11-e064685b82a2 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.842371 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:06.861231 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-4f9be7be-4b41-4433-ba11-e064685b82a2 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026650 Aug 18 17:06:06.861786 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 21/40] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:06.872086 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-bc97e5d9-1c99-4298-825b-070c3d95d740 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.895219 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-bc97e5d9-1c99-4298-825b-070c3d95d740 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027361 Aug 18 17:06:06.895750 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 20/41] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:06.905397 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-84e0656f-6e7e-4c90-a799-e69030b40de7 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.911165 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.wsgi [None req-84e0656f-6e7e-4c90-a799-e69030b40de7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-84e0656f-6e7e-4c90-a799-e69030b40de7 admin admin] Request method failure captured: Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Accept: application/json Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Accept-Encoding: gzip, deflate Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Connection: keep-alive Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Content-Length: 0 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Host: 10.222.0.82 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Openstack-Api-Version: compute 2.90 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Openstack-System-Scope: None Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: User-Agent: python-novaclient Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Auth-Token: gAAAAABi_nF-ryYvnCquFQ3nO0121WlxDdahRC1v1GYNdt4ouBf_X7c8flWyilNE5pEA_wP5t4khbwWi2b6CfDu5nxnNyitO5Pmq_lzOxxwnjvtm9asRw4ACbhVODO4Wd3tNXPI3YTifwXfCSbpbCZXiOI4EgF7eBnAowk6bp2qZoUe9lKPO7G8 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Domain-Id: None Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Domain-Name: None Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Identity-Status: Confirmed Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Is-Admin-Project: True Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Domain-Id: default Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Domain-Name: Default Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Name: admin Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Role: admin,member,reader Aug 18 17:06:06.914380 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Roles: admin,member,reader Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant: admin Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant-Name: admin Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User: admin Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Domain-Id: default Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Domain-Name: Default Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Id: 329c213a845c4ab2a0642e5a7dbd4b18 Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Name: admin Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: method: > Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: exception: Flavor 42 could not be found. Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: action_args: {'id': '42'} Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:06.920549 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:06.921651 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:06.922956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-84e0656f-6e7e-4c90-a799-e69030b40de7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:06.924213 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-84e0656f-6e7e-4c90-a799-e69030b40de7 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014817 Aug 18 17:06:06.924213 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 22/42] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:07.877358 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-bc97e5d9-1c99-4298-825b-070c3d95d740 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:07.878355 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-bc97e5d9-1c99-4298-825b-070c3d95d740 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 18 17:06:07.878749 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 21/43] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:08.399201 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-698a6f46-ed20-4af1-beba-1746ad3c9902 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.404503 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.wsgi [None req-698a6f46-ed20-4af1-beba-1746ad3c9902 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-698a6f46-ed20-4af1-beba-1746ad3c9902 admin admin] Request method failure captured: Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Accept: application/json Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Accept-Encoding: gzip, deflate Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Connection: keep-alive Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Content-Length: 0 Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Host: 10.222.0.82 Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Openstack-Api-Version: compute 2.90 Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Openstack-System-Scope: None Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: User-Agent: python-novaclient Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Auth-Token: gAAAAABi_nF_Qs_qeCmCxMfHXJK4b1vbtbpE6A2TcXjhO48Z5ep3rDevWnATaBrilkhTjs6995PzekhXaTLZzRpmZ64guVK5avmapItuR7t9QWnqjZw2x_pca94QIqorVG2Pln1oUiAO2YJtLfo01nxWEmiFIf9X7xMiopGs-BUEO__1KkfR4gY Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Domain-Id: None Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Domain-Name: None Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Identity-Status: Confirmed Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Is-Admin-Project: True Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Domain-Id: default Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Domain-Name: Default Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Name: admin Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Role: admin,member,reader Aug 18 17:06:08.406017 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Roles: admin,member,reader Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant: admin Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant-Name: admin Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User: admin Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Domain-Id: default Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Domain-Name: Default Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Id: 329c213a845c4ab2a0642e5a7dbd4b18 Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Name: admin Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: method: > Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: exception: Flavor 84 could not be found. Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: action_args: {'id': '84'} Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:08.407577 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:08.408405 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.409573 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-698a6f46-ed20-4af1-beba-1746ad3c9902 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:08.410555 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-698a6f46-ed20-4af1-beba-1746ad3c9902 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390140 Aug 18 17:06:08.410555 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 23/44] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:08.417677 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-5e943a28-e99e-4cf9-9a52-56a9a96d0412 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.433359 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-5e943a28-e99e-4cf9-9a52-56a9a96d0412 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019759 Aug 18 17:06:08.433887 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 22/45] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:08.443305 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-fae8587b-a22a-41ae-a81f-60daeebf79ac admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.458271 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-fae8587b-a22a-41ae-a81f-60daeebf79ac admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018507 Aug 18 17:06:08.458787 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 24/46] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:08.468612 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-d1212643-61d3-41e5-a6db-745891962689 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.473835 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.wsgi [None req-d1212643-61d3-41e5-a6db-745891962689 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-d1212643-61d3-41e5-a6db-745891962689 admin admin] Request method failure captured: Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Accept: application/json Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Accept-Encoding: gzip, deflate Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Connection: keep-alive Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Content-Length: 0 Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Host: 10.222.0.82 Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Openstack-Api-Version: compute 2.90 Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Openstack-System-Scope: None Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: User-Agent: python-novaclient Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Auth-Token: gAAAAABi_nF_Qs_qeCmCxMfHXJK4b1vbtbpE6A2TcXjhO48Z5ep3rDevWnATaBrilkhTjs6995PzekhXaTLZzRpmZ64guVK5avmapItuR7t9QWnqjZw2x_pca94QIqorVG2Pln1oUiAO2YJtLfo01nxWEmiFIf9X7xMiopGs-BUEO__1KkfR4gY Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Domain-Id: None Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Domain-Name: None Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Identity-Status: Confirmed Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Is-Admin-Project: True Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Domain-Id: default Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Domain-Name: Default Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Name: admin Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Role: admin,member,reader Aug 18 17:06:08.475360 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Roles: admin,member,reader Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant: admin Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant-Name: admin Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User: admin Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Domain-Id: default Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Domain-Name: Default Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Id: 329c213a845c4ab2a0642e5a7dbd4b18 Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Name: admin Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: method: > Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: exception: Flavor 84 could not be found. Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: action_args: {'id': '84'} Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:08.476711 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:08.477544 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:08.479471 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-d1212643-61d3-41e5-a6db-745891962689 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:08.480652 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-d1212643-61d3-41e5-a6db-745891962689 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011636 Aug 18 17:06:08.480652 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 23/47] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:09.446030 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-fae8587b-a22a-41ae-a81f-60daeebf79ac admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:09.447109 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-fae8587b-a22a-41ae-a81f-60daeebf79ac admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 18 17:06:09.447493 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 25/48] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:09.968423 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a1b28b0f-b8d1-4097-ab4b-88d77f73c9d4 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:09.974097 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.wsgi [None req-a1b28b0f-b8d1-4097-ab4b-88d77f73c9d4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a1b28b0f-b8d1-4097-ab4b-88d77f73c9d4 admin admin] Request method failure captured: Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Accept: application/json Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Accept-Encoding: gzip, deflate Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Connection: keep-alive Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Content-Length: 0 Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Host: 10.222.0.82 Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Openstack-Api-Version: compute 2.90 Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Openstack-System-Scope: None Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: User-Agent: python-novaclient Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Auth-Token: gAAAAABi_nGBdoyKDZR7ebcIlgFZCSjjb35tqx_cWNkaADJgC7w8OMj3coOh5cOzKdm0sydVGARzotXZthNwLS1pAAExBxnW1NLmuEjpHid73IJZHXw-KGulofKjVEXhPsqzZtqX_6SxVNzxpQ9GlWsTXNj8QqfJkbovGT7DmTzNhb8e-rqLC2o Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Domain-Id: None Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Domain-Name: None Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Identity-Status: Confirmed Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Is-Admin-Project: True Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Domain-Id: default Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Domain-Name: Default Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Project-Name: admin Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Role: admin,member,reader Aug 18 17:06:09.975633 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Roles: admin,member,reader Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant: admin Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-Tenant-Name: admin Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User: admin Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Domain-Id: default Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Domain-Name: Default Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Id: 329c213a845c4ab2a0642e5a7dbd4b18 Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: X-User-Name: admin Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: method: > Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: exception: Flavor 451 could not be found. Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: action_args: {'id': '451'} Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:09.977204 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:09.978605 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: ERROR nova.api.openstack.wsgi Aug 18 17:06:09.984320 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a1b28b0f-b8d1-4097-ab4b-88d77f73c9d4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:09.985560 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a1b28b0f-b8d1-4097-ab4b-88d77f73c9d4 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394532 Aug 18 17:06:09.985560 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 24/49] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 17:06:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:09.987681 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-50f7a985-686e-449a-bdfb-0fba57c7a5be admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:10.002519 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-50f7a985-686e-449a-bdfb-0fba57c7a5be admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018519 Aug 18 17:06:10.003062 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 26/50] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 17:06:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:10.012406 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:10.027771 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019022 Aug 18 17:06:10.028297 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 25/51] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 17:06:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:10.037358 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-423b5a49-2ab8-40ab-9d1c-2c148f7ddd6d admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:10.043629 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.wsgi [None req-423b5a49-2ab8-40ab-9d1c-2c148f7ddd6d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-423b5a49-2ab8-40ab-9d1c-2c148f7ddd6d admin admin] Request method failure captured: Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Accept: application/json Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Accept-Encoding: gzip, deflate Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Connection: keep-alive Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Content-Length: 0 Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Host: 10.222.0.82 Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Openstack-Api-Version: compute 2.90 Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Openstack-System-Scope: None Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: User-Agent: python-novaclient Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Auth-Token: gAAAAABi_nGBdoyKDZR7ebcIlgFZCSjjb35tqx_cWNkaADJgC7w8OMj3coOh5cOzKdm0sydVGARzotXZthNwLS1pAAExBxnW1NLmuEjpHid73IJZHXw-KGulofKjVEXhPsqzZtqX_6SxVNzxpQ9GlWsTXNj8QqfJkbovGT7DmTzNhb8e-rqLC2o Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Domain-Id: None Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Domain-Name: None Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Identity-Status: Confirmed Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Is-Admin-Project: True Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Domain-Id: default Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Domain-Name: Default Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Project-Name: admin Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Role: admin,member,reader Aug 18 17:06:10.045143 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Roles: admin,member,reader Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/77b6b270950a499cb6b0da7c630c03b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant: admin Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant-Id: 77b6b270950a499cb6b0da7c630c03b6 Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-Tenant-Name: admin Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User: admin Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Domain-Id: default Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Domain-Name: Default Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Id: 329c213a845c4ab2a0642e5a7dbd4b18 Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: X-User-Name: admin Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: method: > Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: exception: Flavor 451 could not be found. Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: action_args: {'id': '451'} Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:10.046690 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:10.047713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: ERROR nova.api.openstack.wsgi Aug 18 17:06:10.048802 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-423b5a49-2ab8-40ab-9d1c-2c148f7ddd6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:10.049766 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-423b5a49-2ab8-40ab-9d1c-2c148f7ddd6d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012661 Aug 18 17:06:10.049766 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 27/52] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 17:06:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:11.017036 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:11.018043 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 18 17:06:11.018438 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 26/53] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:11.537021 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-e0f234fe-444e-4dd4-879a-3b604cc426a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:11.610713 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-e0f234fe-444e-4dd4-879a-3b604cc426a1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.452679 Aug 18 17:06:11.611216 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 28/54] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 17:06:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:06:12.580302 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:12.581295 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 18 17:06:12.581686 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 27/55] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:13.100809 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-e3e803db-53ee-4075-9aa9-19df976b2329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:13.171340 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-e3e803db-53ee-4075-9aa9-19df976b2329 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.451387 Aug 18 17:06:13.171891 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 29/56] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 17:06:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:06:14.135143 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:14.136525 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Aug 18 17:06:14.136927 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 28/57] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:14.777673 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-c33e7487-eb01-465a-a744-45ccc1a7db07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:14.846522 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-c33e7487-eb01-465a-a744-45ccc1a7db07 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.568538 Aug 18 17:06:14.847108 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 30/58] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 17:06:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:06:15.817364 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:15.818384 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 18 17:06:15.818769 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 29/59] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:16.345606 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-e387bb0b-90d9-4c6b-94b9-208271e7b26c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:16.439918 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-e387bb0b-90d9-4c6b-94b9-208271e7b26c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.479503 Aug 18 17:06:16.440386 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 31/60] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 17:06:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:06:17.406467 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:17.407495 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 18 17:06:17.407893 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 30/61] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:17.928595 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-4acfa025-9d76-4a6e-921e-9f65665cdb07 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:17.949501 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-4acfa025-9d76-4a6e-921e-9f65665cdb07 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403503 Aug 18 17:06:17.950033 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 32/62] 10.222.0.82 () {60 vars in 1202 bytes} [Thu Aug 18 17:06:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:11.491513 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.492535 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-a88c4fbc-8f96-4a53-88da-940523834fdc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 18 17:07:11.492937 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 31/63] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:11.503524 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:11.882127 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-00a3405a-778a-4dc0-89b9-6cafcebec5de admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.902493 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-00a3405a-778a-4dc0-89b9-6cafcebec5de admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403463 Aug 18 17:07:11.903053 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 33/64] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:11.924006 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG dbcounter [-] [106107] Writing DB stats nova_api:SELECT=14 {{(pid=106107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:11.928423 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-c0c08d66-0ace-4f25-8e27-ae2eed0475ef admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.936050 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-c0c08d66-0ace-4f25-8e27-ae2eed0475ef admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013527 Aug 18 17:07:11.936874 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 32/65] 10.222.0.82 () {60 vars in 1283 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:11.949428 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-6257f197-5490-49cc-ad44-d0cf00c9725d admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.957408 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-6257f197-5490-49cc-ad44-d0cf00c9725d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011409 Aug 18 17:07:11.957974 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 34/66] 10.222.0.82 () {60 vars in 1286 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:11.969503 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.977201 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011283 Aug 18 17:07:11.979595 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 33/67] 10.222.0.82 () {60 vars in 1286 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:11.989437 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-6481193e-f425-4c48-9b5a-e464aa59186d admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.997753 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-6481193e-f425-4c48-9b5a-e464aa59186d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011985 Aug 18 17:07:11.998263 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 35/68] 10.222.0.82 () {60 vars in 1283 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:23.222839 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:23.223898 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 18 17:10:23.224294 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 34/69] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:23.367629 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_api:SELECT=6 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:23.524566 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:23.526878 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:10:23.526878 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: warnings.warn(msg) Aug 18 17:10:23.528063 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:23.528536 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:23.528959 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:23.529669 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:23.530728 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:23.531172 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:23.564735 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-f04edcbb-402f-4a87-96e7-6c9282523f9e admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198539 Aug 18 17:10:23.565295 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 36/70] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 17:10:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:10:24.391180 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:24.392173 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 18 17:10:24.392569 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 35/71] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:10:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:10:24.585902 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:24.588308 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:10:24.588308 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: warnings.warn(msg) Aug 18 17:10:24.589402 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:24.589899 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:24.590321 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:24.591061 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:24.591498 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:24.591907 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:24.612232 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-df7abdb2-c941-4e87-b303-2ec5c3324314 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077940 Aug 18 17:10:24.612738 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 37/72] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 17:10:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:10:35.895829 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:35.896852 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 18 17:10:35.897239 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 36/73] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:10:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:36.039701 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_cell0:SELECT=4 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:36.040417 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_cell1:SELECT=4 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:36.041028 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG dbcounter [-] [106108] Writing DB stats nova_api:SELECT=8 {{(pid=106108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:36.089782 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:36.092421 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:10:36.092421 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: warnings.warn(msg) Aug 18 17:10:36.093510 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:36.095600 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:36.095600 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.095600 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:36.095883 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:36.096029 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.121863 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-40363b33-7c7d-454d-923d-240913fc3a34 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086567 Aug 18 17:10:36.127233 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 38/74] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 17:10:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:36.953402 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: DEBUG nova.api.openstack.wsgi [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] Calling method '>' {{(pid=106107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:36.954405 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: INFO nova.api.openstack.requestlog [None req-0afa6386-535f-4b61-8ba8-b0ea19923415 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 18 17:10:36.954803 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: [pid: 106107|app: 0|req: 37/75] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 17:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:37.144799 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG nova.api.openstack.wsgi [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Calling method '>' {{(pid=106108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.147207 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:10:37.147207 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: warnings.warn(msg) Aug 18 17:10:37.148308 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.148786 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.149216 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.149956 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.150429 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.150844 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: DEBUG oslo_concurrency.lockutils [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.172646 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: INFO nova.api.openstack.requestlog [None req-f322eeda-fa84-4686-bfba-d2c4dfa263f8 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079260 Aug 18 17:10:37.173193 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: [pid: 106108|app: 0|req: 39/76] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 17:10:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:36.177784 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: Thu Aug 18 17:11:36 2022 - graceful shutdown triggered... Aug 18 17:11:36.178300 dv-cinder-853679-1-iscsi devstack@n-api.service[106108]: Gracefully killing worker 2 (pid: 106108)... Aug 18 17:11:36.177911 dv-cinder-853679-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 17:11:36.179322 dv-cinder-853679-1-iscsi devstack@n-api.service[106107]: Gracefully killing worker 1 (pid: 106107)... Aug 18 17:11:37.178948 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: worker 1 buried after 1 seconds Aug 18 17:11:37.179476 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: worker 2 buried after 1 seconds Aug 18 17:11:37.179476 dv-cinder-853679-1-iscsi devstack@n-api.service[106106]: goodbye to uWSGI. Aug 18 17:11:37.180528 dv-cinder-853679-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 17:11:37.181077 dv-cinder-853679-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 17:11:37.184414 dv-cinder-853679-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 17:11:37.193959 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 17:11:37.196538 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 17:11:37 2022] *** Aug 18 17:11:37.196702 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 17:11:37.196831 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 17:11:37.196943 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: nodename: dv-cinder-853679-1-iscsi Aug 18 17:11:37.197051 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: machine: x86_64 Aug 18 17:11:37.197171 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: clock source: unix Aug 18 17:11:37.197277 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: pcre jit disabled Aug 18 17:11:37.197383 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: detected number of CPU cores: 4 Aug 18 17:11:37.197498 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: current working directory: / Aug 18 17:11:37.197605 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: detected binary path: /usr/bin/uwsgi-core Aug 18 17:11:37.197737 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: your processes number limit is 47680 Aug 18 17:11:37.197737 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: your memory page size is 4096 bytes Aug 18 17:11:37.197737 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: detected max file descriptor number: 2048 Aug 18 17:11:37.197737 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: lock engine: pthread robust mutexes Aug 18 17:11:37.198056 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: thunder lock: enabled Aug 18 17:11:37.198126 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 17:11:37.198198 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 17:11:37.239227 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: Python main interpreter initialized at 0x55fda97df9c0 Aug 18 17:11:37.239227 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: python threads support enabled Aug 18 17:11:37.239227 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: your server socket listen backlog is limited to 100 connections Aug 18 17:11:37.239227 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: your mercy for graceful operations on workers is 90 seconds Aug 18 17:11:37.239674 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 17:11:37.239674 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: *** Operational MODE: preforking *** Aug 18 17:11:37.239934 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: *** uWSGI is running in multiple interpreter mode *** Aug 18 17:11:37.239934 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: spawned uWSGI master process (pid: 121201) Aug 18 17:11:37.240142 dv-cinder-853679-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 17:11:37.241950 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: spawned uWSGI worker 1 (pid: 121216, cores: 1) Aug 18 17:11:37.241950 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: spawned uWSGI worker 2 (pid: 121217, cores: 1) Aug 18 17:11:37.241950 dv-cinder-853679-1-iscsi devstack@n-api.service[121201]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 17:11:37.909826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 17:11:37.914801 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 17:11:39.083152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:11:39.083152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: from cryptography.utils import int_from_bytes Aug 18 17:11:39.083766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:11:39.083766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: from cryptography.utils import int_from_bytes Aug 18 17:11:39.095589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:11:39.095589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: from cryptography.utils import int_from_bytes Aug 18 17:11:39.096074 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:11:39.096074 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: from cryptography.utils import int_from_bytes Aug 18 17:11:41.507892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 17:11:41.508432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 17:11:41.508609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 17:11:41.509188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 17:11:41.509456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 17:11:41.509860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.510197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.510525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.510853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.511220 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.511576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.511908 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.512424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.512776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.513045 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.513368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.513698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853679-1-iscsi {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.514026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.514528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.514857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.515219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.515540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.515875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.516188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.516702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.518265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.518265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.518265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.518265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.518602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.518824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.519118 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.519382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.519720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.520040 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.520444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853679-1-iscsi {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.520767 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.521081 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.521399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.521832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.522152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.522466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.522792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.523154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.523470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.523820 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.524150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.524475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.524799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.525105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.525416 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.525736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.526053 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.526363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.526672 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.526938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.527424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.527813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.528145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.528475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.528732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.528987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.529363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.529641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.529961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.530267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.530581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.530893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.531220 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.531536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.531842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.532152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.532475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.532799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.533134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.533446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.533772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.534192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.534448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.534758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.535138 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.535461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.535775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.536100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.536424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.536738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.537052 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.537360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.537684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.538026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.538336 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.538591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.538914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.539226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.539550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.539860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.540173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.540480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.540786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.541094 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.541407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.541718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.542022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.542329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.543200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.543516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.543829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.544144 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.544466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.544790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.545101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.545409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.545717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.546026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.546353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.546663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.546997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.547328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.547637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.547949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.548270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.548581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.548891 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.549212 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.549360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 17:11:41.549910 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.550065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 17:11:41.550237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.550403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 17:11:41.550546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.550695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 17:11:41.551164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.551312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 17:11:41.551455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.551455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.551732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.551882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.552964 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.553107 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.553247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.553394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.553549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.553691 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.553860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.554007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.554172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.554318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.554487 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.555019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.555172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.555315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.555457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853679-1-iscsi {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.555599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.556018 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.556182 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.556353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.556582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.556728 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.556949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.557106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.557277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.557535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.557683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.557827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.557978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.558121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.558382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.559087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.559257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.559410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.559567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.559764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.559911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.560053 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.560194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.560345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.560489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.560639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.560788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.560788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.561061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.561217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.561367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.561515 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.561668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.561809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.561958 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.561958 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.562245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.562245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.563104 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853679-1-iscsi {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.563269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.563427 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.563573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.563723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.563865 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.564006 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.564167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.564317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.564460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.564611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.565137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.565288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.565441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.565586 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.565728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.565979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.565979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.566352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.566352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.571052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.571052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.571359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.571507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.571660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.571819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.571965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.572107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.572248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.572389 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.572593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.572747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.572907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.573055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.573197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.573338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.573493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.574139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.574239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.574317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.574396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.574467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.574582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.574776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.574850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.574942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.575117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575293 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.575386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.575550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.575718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.575879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.575962 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.576044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.576133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.576224 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.576302 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.576370 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.576457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.576548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.576637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.576719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.576810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.576900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.576976 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.577058 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.577141 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.577229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.577316 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.577397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.577476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.577578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.577578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.577737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.577818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.577893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.577893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.578025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578158 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.578226 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578226 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.578443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.578679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.578858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.578970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.579062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.579151 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.579236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.579323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.579414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.579496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.579577 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.579658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.579744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.579832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.579924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.580006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.580177 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.580359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.580864 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.581128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.581246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.581491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.581604 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.581822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.581920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.582151 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.582305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.582449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.582600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.582772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.582952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.583171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.583324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.583474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.583617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.583775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.583919 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.584072 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.584222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.584365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.584508 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.584655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.584797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.584948 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.585090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.585248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.585391 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.585644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.586017 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.586254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.586422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.586649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.586802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.586991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.587155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.587307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.587449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.587598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.587741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.587891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.588043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.588194 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.588337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.588492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.588642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.588786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.588928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.589077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.589219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.589371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.590185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.590349 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.590493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.590493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.590843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.591096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.591260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.591404 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.591563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.591800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.591959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.592103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.592252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.592401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.592552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.592695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.592857 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.593001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.593158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.593308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.593458 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.593600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.593750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.593906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.594063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.594206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.594355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.594504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.594660 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.594828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.595007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.595007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.595305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.595460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.595604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.595745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.595911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.596280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.596500 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.596691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.596927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.597095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.597245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.597395 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.597537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.597694 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:11:41.597837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.597986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.598129 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.598277 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.598431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.598585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.598728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.598876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599061 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599207 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.599669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.600063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.600215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.600358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.600506 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.600655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.600796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.601005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.601247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.601404 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.601548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.601689 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.601931 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.602080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.602232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.602384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.602526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.602675 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.602824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603519 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.603979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.604206 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.604352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.604495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.604636 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.604787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.604939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.605125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.605794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.605942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.606312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.606484 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.606711 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.606865 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.607095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.607269 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.607497 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.607661 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.607805 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.607955 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.608115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.608265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.608407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.608558 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.608789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609392 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.609984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.610125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.610283 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.610426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.610576 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.610727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.610869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.611084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.611084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.611456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.611612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.611764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.611931 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.612168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.612334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.612486 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.612638 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.612782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.612924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.613111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.613265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.613417 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.613567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.613710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.613853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.614002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.614187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.614423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.614576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.614726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.614884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615652 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615793 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.615942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.616245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.616624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.616847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.616996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.617138 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.617289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.617438 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.617687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.617835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.617978 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.618128 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.618280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.618423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.618582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.618759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.618921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619070 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619237 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.619978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.620128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.620285 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.620434 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.620583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.620765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.620765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.621147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.621293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.621575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.621808 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.621955 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.622108 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.622349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.622506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.622649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.622792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.622967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.623136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.623136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.623420 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.623563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.623705 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.623859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.624020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.624285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.624447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.624603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.624752 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.624904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625517 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.625946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.626095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.626245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.626245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.626726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.626892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.627146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.627300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.627456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.627608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.627855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.627855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.628139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.628289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.628451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.628603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.628745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.628894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.629048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.629200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.629352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.629495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.629645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.630377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.630535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.630680 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.630822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.631030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.631235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.631388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.631542 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.632013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.632164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.632316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.632582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.632732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.632875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633464 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633747 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.633900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.634043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.634194 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.634435 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.634584 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.634727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.634878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.635959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.636110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.636253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.636521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.637009 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.637247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.637602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.637777 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638206 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.638984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.639131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.639290 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.639440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.639597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.639739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.639890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.640040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.640040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.640393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.640544 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.640694 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.640853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.641003 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.641325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.641503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.641656 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.641799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.641940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.642279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.642451 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.642621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.642879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.643964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.644106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.644258 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.644428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.644752 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.644878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.644988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645212 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.645918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.646804 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647117 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647839 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.647928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648034 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.648968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649647 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649826 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649908 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.649988 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650067 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650328 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650650 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650909 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.650995 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651154 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651472 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651564 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.651824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.652507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.652685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.652846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.653975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.654192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.654292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.654518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.654647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.654837 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.654961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.655188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.655295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.655503 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.655602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.655818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.655906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.656145 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.656253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.656463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.656575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.656779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.656887 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.657096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.657216 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.657410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.657507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.657715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.657819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658132 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658342 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.658983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.659103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.659300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.659399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.659607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.659705 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.659917 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.660008 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.660233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.660322 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.660546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.660818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.660928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.661150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.661249 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.661467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.661561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.661775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.661877 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.662092 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.662182 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.662403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.662492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.662721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.662834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.663062 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.663211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.663462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.663553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.663770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.663869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.664083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.664173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.664394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.664484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.664713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.664850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.665931 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.666033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.666241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.666366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.666545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.666673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.666855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.667018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.667174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.667337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.667482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.667719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.668500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.668591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.668813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.668942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.669132 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.669215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.669442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.669530 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.669755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.669835 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.670065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.670145 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.670371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.670457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.670676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.670756 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.671459 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.671639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.671639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.671928 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.672853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673029 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.673977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.674074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.674289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.674379 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.674595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.674685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.674923 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.675031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.675257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.675587 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.676173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.676479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.676580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.676789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.676879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.677119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.677233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.677442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.677537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.677757 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.677846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.678077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.678169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.678413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.678516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.678715 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.678832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.679052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.679156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.679376 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.679474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.679691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.679792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680001 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.680945 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.681968 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.682184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.682287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.682493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.682582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.682803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683058 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683330 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.683877 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.684085 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.684184 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.684412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.684502 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.684739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.684829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685383 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.685998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.686087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.686305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.686402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.686615 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.686732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.686960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.687128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.687256 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.687454 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.687604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.687763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.687915 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688243 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688390 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.688999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.689222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.689315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.689561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.689659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.689878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.689973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.690185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.690275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.690493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.690584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.690798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.690886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.691145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.691243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.691456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.691566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.691761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.691850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.692995 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.693090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.693301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.693398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.693612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.693698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.693923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.694027 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.694247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.694344 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.694561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.694659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.694882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695514 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695823 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.695921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.696131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.696228 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.696447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.696545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.696759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.696849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.697068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.697166 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.697390 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.697496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.697702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.697792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.698020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.698111 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.698334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.698437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.698666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.698830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699037 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.699948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700263 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700576 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.700983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.701205 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.701297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.701521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.701818 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.701977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.702127 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.702297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.702455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.702573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.702772 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.702862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.703113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.703250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.703429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.703518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.703735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.703862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704681 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.704997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.705087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.705302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.705391 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.705615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.705719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.705922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.706020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.706286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.706375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.706611 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.706710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.706950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707058 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707584 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707899 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.707998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.708219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.708318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.708536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.708634 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.708883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.708987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.709207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.709300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.709462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.709555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.709778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.709868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.710094 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.710186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.710413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.710510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.710728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.710827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.711068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.711175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.711386 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.711516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.711696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.711826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712314 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.712950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.713058 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.713272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.713423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.713574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.713715 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.713899 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.714066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.714292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715042 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715253 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715568 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.715978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.716211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.716301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.716537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.716637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.716864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.716963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.717175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.717265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.717493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.717591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.717804 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.717900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.718125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.718221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.718445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.718536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.718756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.718846 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.719103 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.719236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.719414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.719525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.719735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.719826 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.720055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.720160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.720367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.720456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.720689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.720913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.721106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.721271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.721431 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.721596 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.721750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.721931 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.722076 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.722262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.722408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.722588 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.722701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.722930 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723060 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723673 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.723997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.724204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.724303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.724522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.724621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.724831 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.724932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.725141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.725229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.725460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.725619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.725770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.725913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.726063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.726210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.726356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.726495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.726642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.726799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727386 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.727911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728836 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.728934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.729140 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.729236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.729456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.729602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.729747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.729844 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.730063 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.730695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.730935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.731183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.731286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.731513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.731607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.731842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732138 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.732854 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.733076 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.733195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.733415 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.733519 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.733737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.733841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.734049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.734147 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.734363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.734471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.734668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.734766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.735989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.736285 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.736377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.736599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.736696 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.736904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737842 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.737952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.738178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.738276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.738489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.738588 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.738821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.738941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.739159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.739329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.739475 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.739633 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.739780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.739927 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740217 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740816 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.740992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.741153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.741297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.741385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.741608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.741707 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.741923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.742079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.742304 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.742450 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.742593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.742740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.742890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.743903 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.744121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.744218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.744443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.744555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.744762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.744989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.745080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.745327 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.745424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.745652 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.745789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746321 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746731 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.746985 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.747101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.747300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.747416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.747610 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.747723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.747924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.748023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.748241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.748356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.748574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.748680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.748900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749887 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.749990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.750196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.750288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.750512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.750609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.750825 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.750946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.751186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.751279 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.751509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.751598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.751820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.751941 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.752139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.752264 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.752456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.752555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.752763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.752866 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.753074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.753165 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.753384 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.753474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.753699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.753799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754011 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754115 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.754960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.755071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.755271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.755360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.755585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.755764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.755903 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.756922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.757198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.757341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.757504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.757652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.757791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.757997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.758140 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.758296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.758443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.758584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.758729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.758875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759057 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759498 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.759871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.760035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.760182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.760370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.760496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.760708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.760799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.761031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.761122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.761419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.761513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.761803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.762028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.762270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.762425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.762557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.762752 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.763105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.763314 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.763440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.763675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.763805 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.764018 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.764154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.764359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.764585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.764804 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.764964 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.765083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.765287 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.765418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.765606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.765732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.765924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.766065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.766256 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.766406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.766589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.766717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.766918 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.767075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.767301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.767428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768758 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.768893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769031 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769714 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.769985 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770782 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.770936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771210 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.771889 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.772947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.773114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.773263 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.773442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.773583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.773796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.773938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.774149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.774297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.774427 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.774563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.774693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.774835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.775926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.776062 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 17:11:41.776257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.776610 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.777504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.777975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.778583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.779399 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.779399 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.779633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.779900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.780453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.780791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.781115 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.781454 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.781788 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.782098 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.782430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.784765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.785807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.785807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.785807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.785807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.786319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.786319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.786634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.786967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.787279 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.787616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.787932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.788251 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.788568 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.788885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.789201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.789510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.789818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.790125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.790430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.790743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.791096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.791410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.791713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.792141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.792455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.793414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.793903 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.794223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.794550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.794873 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.795209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.795541 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.795855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.796186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.796531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.796938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.797185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.797494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.797804 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.798109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.798421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.798742 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.799078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.799387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.799691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.800002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.800308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.800613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.801216 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.801483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.801792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.802093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.802395 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.802730 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.803026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.803331 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.803636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.803942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.804246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.804548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.804852 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.805155 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.805499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.805783 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.806113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.806426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.806745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.807080 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.807455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.807708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.808029 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.808493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.809070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.809424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.809759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.810074 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.810387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.810699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.811035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.811351 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.811664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.811991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.812318 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.812623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.812948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.813261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.813581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.813897 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.814206 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.814533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.814842 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.815179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.815493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.815802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.816112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.816428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.816737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.817047 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.817361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.817676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.818001 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.818324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.818635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.818990 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.819317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.819662 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.820329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.820329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.820599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.820911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.821249 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.821555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:11:41.821798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 17:11:41.838793 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO dbcounter [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Registered counter for database nova_api Aug 18 17:11:41.860606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_db.sqlalchemy.engines [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:41.867227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writer thread running {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:41.884784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO dbcounter [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Registered counter for database nova_api Aug 18 17:11:41.905597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_db.sqlalchemy.engines [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:41.913410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writer thread running {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:41.924321 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.context [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),baddab50-6834-47ff-9a53-35237c9c57ce(cell1) {{(pid=121216) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 17:11:41.933434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.933434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.933434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.933434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.933434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.934218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.936285 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO dbcounter [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Registered counter for database nova_cell0 Aug 18 17:11:41.940395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO dbcounter [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Registered counter for database nova_cell1 Aug 18 17:11:41.947901 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_db.sqlalchemy.engines [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:41.950294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_db.sqlalchemy.engines [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:41.957328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writer thread running {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:41.957670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writer thread running {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:41.970954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.context [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),baddab50-6834-47ff-9a53-35237c9c57ce(cell1) {{(pid=121217) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 17:11:41.975022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.975492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.977046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.977811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.978265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.980360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.982643 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO dbcounter [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Registered counter for database nova_cell0 Aug 18 17:11:41.986672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO dbcounter [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Registered counter for database nova_cell1 Aug 18 17:11:41.994040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_db.sqlalchemy.engines [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:41.995962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_db.sqlalchemy.engines [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:42.002735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writer thread running {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:42.004047 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writer thread running {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:42.109006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO dbcounter [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Registered counter for database nova_cell0 Aug 18 17:11:42.115944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_db.sqlalchemy.engines [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:42.120379 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writer thread running {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:42.154008 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO dbcounter [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Registered counter for database nova_cell0 Aug 18 17:11:42.161938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_db.sqlalchemy.engines [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:11:42.167030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writer thread running {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:11:42.444070 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: WARNING keystonemiddleware.auth_token [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:11:42.452540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: WARNING keystonemiddleware.auth_token [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:11:42.491538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: WARNING keystonemiddleware.auth_token [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:11:42.499529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: WARNING keystonemiddleware.auth_token [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:11:42.805409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: WARNING keystonemiddleware.auth_token [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:11:42.812301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: WARNING keystonemiddleware.auth_token [None req-39b5d4ec-ab60-4395-9049-71bdda1ec10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:11:42.817572 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fda97df9c0 pid: 121216 (default app) Aug 18 17:11:42.854683 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: WARNING keystonemiddleware.auth_token [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:11:42.861284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: WARNING keystonemiddleware.auth_token [None req-d3860d5b-d448-4227-8d90-3ce9704e7cde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:11:42.866565 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fda97df9c0 pid: 121217 (default app) Aug 18 17:12:18.583605 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:18.585487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:18.586478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:18.587720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:19.174619 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:19.176247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:19.177288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:19.178187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:20.200174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-11df7c85-b0e8-4735-81fe-661ef8bd414c tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Action: 'create', calling method: .version_select at 0x7fd1f8c814c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-949133981", "metadata": {"Type": "work"}}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:20.609055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cf5e9d72-18fe-4f54-9035-aefe86161a67 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Action: 'create', calling method: .version_select at 0x7fd1f8c83550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1553811056", "metadata": {"Type": "work"}}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cf5e9d72-18fe-4f54-9035-aefe86161a67 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Request method failure captured: Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 122 Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nLzdhZnKkQcrdHXmNbVidyORFtLkVP3fAeLghEVL-Dr2wybKoF1VD-Ui2DXQiD72J2fteIHriR3GYca41cQXgvqXknihEQ2StxO9GubfAMrTAZqa16brU6xm_UGKftYjW_IhMll65lMuoUeeMyTQVm74dm0fbnTeEQuMFO5Gn6SJu0 Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:12:20.622977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 29192b00b5c6486b942b49c5fb2641ce Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1553811056", "metadata": {"Type": "work"}}} Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: Aug 18 17:12:20.624525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1553811056', 'metadata': {'Type': 'work'}}}} Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise error Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:20.625378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 17:12:20.626718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 17:12:20.630570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 17:12:20.630570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:20.630570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cf5e9d72-18fe-4f54-9035-aefe86161a67 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:20.630570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cf5e9d72-18fe-4f54-9035-aefe86161a67 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.462339 Aug 18 17:12:20.630570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 1/1] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 17:12:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:12:20.974252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7c1618da-b2c5-40cd-90c2-f545752966db tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Action: 'create', calling method: .version_select at 0x7fd1f8c835e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-407066014"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-11df7c85-b0e8-4735-81fe-661ef8bd414c tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.052787 Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 1/2] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 17:12:18 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4055 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87f513cd-1f26-4499-af1c-edbb9a0adfc8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Action: 'create', calling method: .version_select at 0x7fd1f8b54310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327297484", "metadata": {"Type": "work"}}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87f513cd-1f26-4499-af1c-edbb9a0adfc8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Request method failure captured: Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 119 Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nLzdhZnKkQcrdHXmNbVidyORFtLkVP3fAeLghEVL-Dr2wybKoF1VD-Ui2DXQiD72J2fteIHriR3GYca41cQXgvqXknihEQ2StxO9GubfAMrTAZqa16brU6xm_UGKftYjW_IhMll65lMuoUeeMyTQVm74dm0fbnTeEQuMFO5Gn6SJu0 Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:12:22.796253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 29192b00b5c6486b942b49c5fb2641ce Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-327297484", "metadata": {"Type": "work"}}} Aug 18 17:12:22.798393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-327297484', 'metadata': {'Type': 'work'}}}} Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise error Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi '0' Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:22.799946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 17:12:22.801440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 17:12:22.802667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 17:12:22.802667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.802667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87f513cd-1f26-4499-af1c-edbb9a0adfc8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:22.802667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-87f513cd-1f26-4499-af1c-edbb9a0adfc8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011671 Aug 18 17:12:22.802667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 2/3] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 17:12:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:12:22.802667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7948336d-dfcf-4cb4-8983-cb8aea590f99 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Calling method '.version_select at 0x7fd1f8b63d30>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7c1618da-b2c5-40cd-90c2-f545752966db tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.078938 Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 2/4] 10.222.0.82 () {60 vars in 1155 bytes} [Thu Aug 18 17:12:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2083 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e36a77be-31ca-495d-9433-d8c01989b8ef tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Action: 'create', calling method: .version_select at 0x7fd1f8b0f940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1589345565", "metadata": {"Type": "work"}}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e36a77be-31ca-495d-9433-d8c01989b8ef tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Request method failure captured: Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 119 Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nLzdhZnKkQcrdHXmNbVidyORFtLkVP3fAeLghEVL-Dr2wybKoF1VD-Ui2DXQiD72J2fteIHriR3GYca41cQXgvqXknihEQ2StxO9GubfAMrTAZqa16brU6xm_UGKftYjW_IhMll65lMuoUeeMyTQVm74dm0fbnTeEQuMFO5Gn6SJu0 Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:12:22.803509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 29192b00b5c6486b942b49c5fb2641ce Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1589345565", "metadata": {"Type": "work"}}} Aug 18 17:12:22.805689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1589345565', 'metadata': {'Type': 'work'}}}} Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise error Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi '' Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:22.806640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 17:12:22.807921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 17:12:22.809093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 17:12:22.809093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:22.809093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e36a77be-31ca-495d-9433-d8c01989b8ef tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:22.809093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e36a77be-31ca-495d-9433-d8c01989b8ef tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019556 Aug 18 17:12:22.809093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 3/5] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 17:12:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:12:22.809093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-12a6c042-af6b-40ed-a102-53736db5c386 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8c38940>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:22.971281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7948336d-dfcf-4cb4-8983-cb8aea590f99 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f" status: 200 len: 352 microversion: 2.1 time: 0.322100 Aug 18 17:12:22.978361 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 3/6] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:22 2022] GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f => generated 352 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:22.984155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-429a9f43-c87c-4a41-8870-6da61866bcfa tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Calling method '.version_select at 0x7fd1f8b63c10>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:23.024241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-12a6c042-af6b-40ed-a102-53736db5c386 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 200 len: 344 microversion: 2.1 time: 0.287971 Aug 18 17:12:23.025304 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:22 2022] GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 344 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:23.165721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-429a9f43-c87c-4a41-8870-6da61866bcfa tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] HTTP exception thrown: Volume tempest-invalid-655176991 could not be found. Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-429a9f43-c87c-4a41-8870-6da61866bcfa tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Request method failure captured: Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-655176991 HTTP/1.1 Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nLzdhZnKkQcrdHXmNbVidyORFtLkVP3fAeLghEVL-Dr2wybKoF1VD-Ui2DXQiD72J2fteIHriR3GYca41cQXgvqXknihEQ2StxO9GubfAMrTAZqa16brU6xm_UGKftYjW_IhMll65lMuoUeeMyTQVm74dm0fbnTeEQuMFO5Gn6SJu0 Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:12:23.170606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 29192b00b5c6486b942b49c5fb2641ce Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Volume tempest-invalid-655176991 could not be found. Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'tempest-invalid-655176991'} Aug 18 17:12:23.171566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-655176991 could not be found. (HTTP 404) (Request-ID: req-876c6743-bf54-47b8-b111-4177accee924) Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.172126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:12:23.172996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-655176991 could not be found. Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:23.174103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-655176991 could not be found. Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-655176991 could not be found. Aug 18 17:12:23.178842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.191797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-429a9f43-c87c-4a41-8870-6da61866bcfa tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Returning 404 to user: Volume tempest-invalid-655176991 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:23.195083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-429a9f43-c87c-4a41-8870-6da61866bcfa tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/tempest-invalid-655176991" status: 404 len: 98 microversion: 2.1 time: 0.214423 Aug 18 17:12:23.196780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 4/8] 10.222.0.82 () {58 vars in 1215 bytes} [Thu Aug 18 17:12:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-655176991 => generated 98 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 17:12:23.206252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9d87c187-402f-411c-ab72-c0951e8e144e tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004071 Aug 18 17:12:23.211506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 5/9] 10.222.0.82 () {58 vars in 1140 bytes} [Thu Aug 18 17:12:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 17:12:23.219653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a9147894-9dc2-4267-945b-d6e3797821dd tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007094 Aug 18 17:12:23.220515 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 5/10] 10.222.0.82 () {58 vars in 1137 bytes} [Thu Aug 18 17:12:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 18 17:12:23.235361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e54635b9-9b0c-43c3-86fe-753840f09ddd tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Calling method '.version_select at 0x7fd1f8b2b3a0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:23.276443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-e54635b9-9b0c-43c3-86fe-753840f09ddd tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] HTTP exception thrown: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e54635b9-9b0c-43c3-86fe-753840f09ddd tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Request method failure captured: Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/os-volumes/9ad73c7b-f48d-4003-9ff7-14168d9cae87 HTTP/1.1 Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nLzdhZnKkQcrdHXmNbVidyORFtLkVP3fAeLghEVL-Dr2wybKoF1VD-Ui2DXQiD72J2fteIHriR3GYca41cQXgvqXknihEQ2StxO9GubfAMrTAZqa16brU6xm_UGKftYjW_IhMll65lMuoUeeMyTQVm74dm0fbnTeEQuMFO5Gn6SJu0 Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:12:23.281159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 29192b00b5c6486b942b49c5fb2641ce Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '9ad73c7b-f48d-4003-9ff7-14168d9cae87'} Aug 18 17:12:23.286557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. (HTTP 404) (Request-ID: req-39b79adc-49ac-4871-9e04-229530a2dbf8) Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.287295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:12:23.288532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 17:12:23.290627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e54635b9-9b0c-43c3-86fe-753840f09ddd tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Returning 404 to user: Volume 9ad73c7b-f48d-4003-9ff7-14168d9cae87 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e54635b9-9b0c-43c3-86fe-753840f09ddd tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/9ad73c7b-f48d-4003-9ff7-14168d9cae87" status: 404 len: 109 microversion: 2.1 time: 0.056067 Aug 18 17:12:23.292704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 6/11] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:12:23 2022] DELETE /compute/v2.1/os-volumes/9ad73c7b-f48d-4003-9ff7-14168d9cae87 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:23.294986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-49750c04-ed01-4d0d-962e-294c3fa4aeb8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Calling method '.version_select at 0x7fd1f8b63c10>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:23.336568 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-49750c04-ed01-4d0d-962e-294c3fa4aeb8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] HTTP exception thrown: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-49750c04-ed01-4d0d-962e-294c3fa4aeb8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Request method failure captured: Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/os-volumes/53a8a69c-e835-4be0-a9d2-c14c405041b9 HTTP/1.1 Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nLzdhZnKkQcrdHXmNbVidyORFtLkVP3fAeLghEVL-Dr2wybKoF1VD-Ui2DXQiD72J2fteIHriR3GYca41cQXgvqXknihEQ2StxO9GubfAMrTAZqa16brU6xm_UGKftYjW_IhMll65lMuoUeeMyTQVm74dm0fbnTeEQuMFO5Gn6SJu0 Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:12:23.338518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6299622d253a4d149d68b4bafdece4cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 6299622d253a4d149d68b4bafdece4cf Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesNegativeTest-1181485655 Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 29192b00b5c6486b942b49c5fb2641ce Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesNegativeTest-1181485655-project Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '53a8a69c-e835-4be0-a9d2-c14c405041b9'} Aug 18 17:12:23.339516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. (HTTP 404) (Request-ID: req-5b448e40-e6a5-4a89-864b-c25af3651009) Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.340170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:23.341699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:12:23.342789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-49750c04-ed01-4d0d-962e-294c3fa4aeb8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] Returning 404 to user: Volume 53a8a69c-e835-4be0-a9d2-c14c405041b9 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-49750c04-ed01-4d0d-962e-294c3fa4aeb8 tempest-VolumesNegativeTest-1181485655 tempest-VolumesNegativeTest-1181485655-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/53a8a69c-e835-4be0-a9d2-c14c405041b9" status: 404 len: 109 microversion: 2.1 time: 0.050859 Aug 18 17:12:23.343649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 6/12] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:23 2022] GET /compute/v2.1/os-volumes/53a8a69c-e835-4be0-a9d2-c14c405041b9 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:23.986572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f85758f1-e4a9-4b84-ad48-bdd83ebeb584 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Calling method '.version_select at 0x7fd1f8b0fa60>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:24.045728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-182785f6-ccd5-4e10-921b-b381be1f05ec tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b245e0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:24.066213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f85758f1-e4a9-4b84-ad48-bdd83ebeb584 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f" status: 200 len: 353 microversion: 2.1 time: 0.084144 Aug 18 17:12:24.066829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 7/13] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:23 2022] GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:24.079754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2f71cd39-bbda-42f1-ac1c-a864e8efc8c3 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Calling method '.version_select at 0x7fd1f8acfaf0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:24.156701 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-182785f6-ccd5-4e10-921b-b381be1f05ec tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 200 len: 345 microversion: 2.1 time: 0.122260 Aug 18 17:12:24.157702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 7/14] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:24 2022] GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:24.176410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-20428aab-5055-484f-ac6c-2bfc5fdf60b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Action: 'create', calling method: .version_select at 0x7fd1f8b63ee0>, body: {"snapshot": {"volume_id": "bd14625f-bab2-4263-bfd0-5f910a9c531f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-286163604"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:24.200838 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2f71cd39-bbda-42f1-ac1c-a864e8efc8c3 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f" status: 200 len: 353 microversion: 2.1 time: 0.124784 Aug 18 17:12:24.201687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 8/15] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:24 2022] GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:24.223551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fd217bbc-f11f-4c3e-b939-5f89759ed254 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Calling method '.version_select at 0x7fd1f8b2b3a0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:24.604604 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fd217bbc-f11f-4c3e-b939-5f89759ed254 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f" status: 202 len: 0 microversion: 2.1 time: 0.388351 Aug 18 17:12:24.605512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 9/16] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:12:24 2022] DELETE /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:12:24.620778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-267e1d5b-058c-42e6-9c07-04acd5bb4d37 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Calling method '.version_select at 0x7fd1f8b2b1f0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:25.441370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-20428aab-5055-484f-ac6c-2bfc5fdf60b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.270770 Aug 18 17:12:25.441370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 8/17] 10.222.0.82 () {60 vars in 1162 bytes} [Thu Aug 18 17:12:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:25.451859 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-80438f4b-a4fa-4761-b97c-906ddb398745 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b24b80>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:25.484959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-267e1d5b-058c-42e6-9c07-04acd5bb4d37 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] HTTP exception thrown: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-267e1d5b-058c-42e6-9c07-04acd5bb4d37 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Request method failure captured: Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f HTTP/1.1 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nLyMeKEcMvbBJi-xmrL-7I7NuFkwVXXOW0OudrODZIxTZkd7dbgBumT9KZDzgDMEhVdBsYTrQ9VGWOvvd106M0lbxBE1XawanymKwccDd5Ei_Ptp758xaFtxY34bATJyqX8VqFjsXy_oufR850nLpkloLDSQ_PhhQlQwHuXNOfRCv0 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 0534f4dae3d54429b998f82353578457 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesGetTestJSON-876424756 Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:12:25.487056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0534f4dae3d54429b998f82353578457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0534f4dae3d54429b998f82353578457"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0534f4dae3d54429b998f82353578457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0534f4dae3d54429b998f82353578457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesGetTestJSON-876424756 Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 0534f4dae3d54429b998f82353578457 Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesGetTestJSON-876424756 Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesGetTestJSON-876424756-project Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 67673f940658480983950ba342dc77ae Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesGetTestJSON-876424756-project Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '07d515ee-4adb-45ad-b093-e3b8ae47631f'} Aug 18 17:12:25.488086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. (HTTP 404) (Request-ID: req-cfd9ac01-be8e-4bc8-a5e6-d5cfa08f5607) Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:25.488721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:25.489880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:12:25.490754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-267e1d5b-058c-42e6-9c07-04acd5bb4d37 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] Returning 404 to user: Volume 07d515ee-4adb-45ad-b093-e3b8ae47631f could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-267e1d5b-058c-42e6-9c07-04acd5bb4d37 tempest-VolumesGetTestJSON-876424756 tempest-VolumesGetTestJSON-876424756-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f" status: 404 len: 109 microversion: 2.1 time: 0.876138 Aug 18 17:12:25.491984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 10/18] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:24 2022] GET /compute/v2.1/os-volumes/07d515ee-4adb-45ad-b093-e3b8ae47631f => generated 109 bytes in 880 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:25.672522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-80438f4b-a4fa-4761-b97c-906ddb398745 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.224664 Aug 18 17:12:25.673990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 9/19] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:25 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:25.685647 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-53aec9ec-fd7d-4522-a3ed-724afb1f5e8c tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b2b160>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:25.791863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-53aec9ec-fd7d-4522-a3ed-724afb1f5e8c tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.109803 Aug 18 17:12:25.792625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 11/20] 10.222.0.82 () {58 vars in 1140 bytes} [Thu Aug 18 17:12:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:25.804513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ae26de4b-bf1d-4423-a5e2-8c2cf717c67b tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8af2310>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:25.854683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ae26de4b-bf1d-4423-a5e2-8c2cf717c67b tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.053977 Aug 18 17:12:25.855272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 10/21] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:25 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:26.871273 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-13d890cc-0ade-44db-ba87-9450c99c4e6a tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8afe1f0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:26.964879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-13d890cc-0ade-44db-ba87-9450c99c4e6a tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.101128 Aug 18 17:12:26.978882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 12/22] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:26 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:27.986459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-40446758-d69d-43eb-8ee0-81d2802bb7d5 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b24b80>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:28.174349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-40446758-d69d-43eb-8ee0-81d2802bb7d5 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.192512 Aug 18 17:12:28.177881 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 11/23] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:27 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:29.194532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1e3663c1-c3bf-4b42-8113-cae961ffac22 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b0fe50>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:29.254862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1e3663c1-c3bf-4b42-8113-cae961ffac22 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.067889 Aug 18 17:12:29.261865 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 13/24] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:29 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:30.269096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-49119d64-88bb-4cb4-886b-dcc069efcc94 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b0f9d0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:30.324678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-49119d64-88bb-4cb4-886b-dcc069efcc94 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.059574 Aug 18 17:12:30.325525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 14/25] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:30 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:30.486074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-84371648-0a50-4df2-9dd3-15e0bb840659 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'create', calling method: .version_select at 0x7fd1f8b24670>, body: {"keypair": {"name": "tempest-keypair-772725575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmJSvnqh1rY3V8pQ/vGf1lVZSPuCDLRyzlSxCBsaiDoCiMxNzZ3Nmi62J5KVNFziHlJHPFfTf7sVpMGjXObiG+EFipvO4QH+xZw50vy84d2/H2f1Z6g/b2yHxQow3obow=="}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:30.594464 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-84371648-0a50-4df2-9dd3-15e0bb840659 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:30.625502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-84371648-0a50-4df2-9dd3-15e0bb840659 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for user 22e737cba90b4d8890ecd692e6456470 and project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:30.806742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-84371648-0a50-4df2-9dd3-15e0bb840659 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.635771 Aug 18 17:12:30.808065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 12/26] 10.222.0.82 () {62 vars in 1200 bytes} [Thu Aug 18 17:12:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 638 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 17:12:31.347428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f54e9fc8-3c87-455b-9719-965e2e935b41 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b2b940>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:31.419862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f54e9fc8-3c87-455b-9719-965e2e935b41 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.084754 Aug 18 17:12:31.420483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 15/27] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:31 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:32.436467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8f4668c4-e2d1-4036-9496-a5701e61cb69 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8b2b0d0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:32.512304 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8f4668c4-e2d1-4036-9496-a5701e61cb69 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.075685 Aug 18 17:12:32.512304 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 16/28] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:32 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:32.603248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1992258888", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "networks": [{"uuid": "bfcd358d-bc0c-4ffc-adec-d0ce283df109"}]}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:32.783490 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] validate_networks() for [('bfcd358d-bc0c-4ffc-adec-d0ce283df109', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:12:33.723804 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1400426545", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:33.938362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] validate_networks() for [('9e02a190-793a-4b39-97b9-468a8b8e735b', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:12:35.084963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:12:35.087006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:12:35.088540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:12:35.089551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:12:35.090158 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:12:35.128183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:35.130501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:35.130501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:35.130501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:35.130872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:35.132125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:35.198000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Getting quotas for project 66c908d398424970b13440ee7f6048d6. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:35.232259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Getting quotas for user e72104f038d24821be824a45e108d1ac and project 66c908d398424970b13440ee7f6048d6. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:35.296830 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:12:35.302080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:12:35.508853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d2064802-2e99-4f0e-b945-4573b15476f5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.800421 Aug 18 17:12:35.510194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 13/29] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:12:35.517734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9f2424e7-d582-4e47-a0ac-feed23b86a38 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8198a60>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:35.648371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9f2424e7-d582-4e47-a0ac-feed23b86a38 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 287 microversion: 2.1 time: 0.136515 Aug 18 17:12:35.649104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 14/30] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:35 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:35.654365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0fe6d470-21af-432a-9b09-35aed582f5c7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:35.655235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0fe6d470-21af-432a-9b09-35aed582f5c7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:35.885739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0fe6d470-21af-432a-9b09-35aed582f5c7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:35.913843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0fe6d470-21af-432a-9b09-35aed582f5c7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1215 microversion: 2.1 time: 0.263404 Aug 18 17:12:35.921525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 15/31] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:35 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:35.943357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9956b3a5-7b48-46c1-8697-0b293139d9c4 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f814caf0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:36.098948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:12:36.102062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:12:36.102832 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:12:36.106688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:12:36.106688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:12:36.134501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9956b3a5-7b48-46c1-8697-0b293139d9c4 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "DELETE /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 202 len: 0 microversion: 2.1 time: 0.197328 Aug 18 17:12:36.135642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 16/32] 10.222.0.82 () {58 vars in 1254 bytes} [Thu Aug 18 17:12:35 2022] DELETE /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:12:36.145388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ba42a43e-5204-4268-a5bd-ec2e576e02fe tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f815a160>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:36.154270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:36.155762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:36.157627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:36.163762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:36.164738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:36.166054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:36.225412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for project 289886000851431da2e3aebc3b47be8a. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:36.238559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ba42a43e-5204-4268-a5bd-ec2e576e02fe tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.098165 Aug 18 17:12:36.243837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 17/33] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:36 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:36.268286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for user ecdea0572cc64ca394cd4d977f536d5a and project 289886000851431da2e3aebc3b47be8a. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:36.297174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:12:36.305457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:12:36.637724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d61dc29b-c65d-4297-b25c-7bd8cf02ef9d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.402072 Aug 18 17:12:36.638685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 17/34] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:12:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 3404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:12:36.650031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-917459560", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66034e41-0280-4345-b321-88bd10e4e6db"}], "security_groups": [{"name": "tempest-securitygroup--147772512"}], "key_name": "tempest-keypair-772725575", "user_data": "}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:36.652953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-231909d4-2914-4d67-bd25-9db7ad6f2e5b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:36.657320 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-231909d4-2914-4d67-bd25-9db7ad6f2e5b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:36.872859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-231909d4-2914-4d67-bd25-9db7ad6f2e5b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:36.921702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-231909d4-2914-4d67-bd25-9db7ad6f2e5b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1222 microversion: 2.1 time: 0.274099 Aug 18 17:12:36.922569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 18/35] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:36 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:36.953666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-46080030-f5de-4a8a-8c73-0e5a719405d1 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:36.954748 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-46080030-f5de-4a8a-8c73-0e5a719405d1 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:36.981091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] validate_networks() for [('66034e41-0280-4345-b321-88bd10e4e6db', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:12:37.077259 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-46080030-f5de-4a8a-8c73-0e5a719405d1 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:37.085003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-46080030-f5de-4a8a-8c73-0e5a719405d1 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1215 microversion: 2.1 time: 0.139265 Aug 18 17:12:37.103759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 19/36] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:36 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:37.177655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-108857178", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:37.282239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] validate_networks() for [('9e02a190-793a-4b39-97b9-468a8b8e735b', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:12:37.671015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:12:37.671535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:12:37.672040 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:12:37.672957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:12:37.674372 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:12:37.714523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:37.714523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:37.714523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:37.714523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:37.714971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:37.714971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:37.737694 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:37.746060 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for user 22e737cba90b4d8890ecd692e6456470 and project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:37.789242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:12:37.792790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:12:38.070365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-98f61747-0d5d-4755-80bf-d19b3210c9dc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.430965 Aug 18 17:12:38.076303 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 18/37] 10.222.0.82 () {62 vars in 1188 bytes} [Thu Aug 18 17:12:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 17:12:38.101237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-604366de-7596-490c-aeb7-8fc21d58bb59 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f815a9d0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:38.177165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-604366de-7596-490c-aeb7-8fc21d58bb59 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.099481 Aug 18 17:12:38.179578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 19/38] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:38 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:38.185591 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:12:38.187118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:12:38.193171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:12:38.193171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:12:38.193171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:12:38.193753 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c1f28574-b191-4168-8f7a-f9ec1d0fe5ca tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:38.195363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c1f28574-b191-4168-8f7a-f9ec1d0fe5ca tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:38.202225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:38.202970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:38.203615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:38.204592 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:38.205442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:38.206089 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:38.229179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for project 289886000851431da2e3aebc3b47be8a. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:38.251334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for user ecdea0572cc64ca394cd4d977f536d5a and project 289886000851431da2e3aebc3b47be8a. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:38.275984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:12:38.282567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:12:38.375955 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c1f28574-b191-4168-8f7a-f9ec1d0fe5ca tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.385819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c1f28574-b191-4168-8f7a-f9ec1d0fe5ca tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.388783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c1f28574-b191-4168-8f7a-f9ec1d0fe5ca tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.408850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c1f28574-b191-4168-8f7a-f9ec1d0fe5ca tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1280 microversion: 2.20 time: 0.225979 Aug 18 17:12:38.410384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 20/39] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:38 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:38.416087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6280e2de-1425-479a-9972-04315b77a79c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:38.430577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6280e2de-1425-479a-9972-04315b77a79c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:38.496319 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6280e2de-1425-479a-9972-04315b77a79c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.508360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6280e2de-1425-479a-9972-04315b77a79c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1215 microversion: 2.1 time: 0.096776 Aug 18 17:12:38.519052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d1e1bf21-265a-4686-9f2f-d3f3a25aa823 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.341736 Aug 18 17:12:38.519052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 20/40] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:12:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:12:38.532462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 21/41] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:38 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:38.559163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-118b8b26-2064-4596-9994-f0e03bf41cb5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:38.562199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-118b8b26-2064-4596-9994-f0e03bf41cb5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:38.668200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-118b8b26-2064-4596-9994-f0e03bf41cb5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.676181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-118b8b26-2064-4596-9994-f0e03bf41cb5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1221 microversion: 2.1 time: 0.141119 Aug 18 17:12:38.679348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 21/42] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:38 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:39.192862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a6726c34-205b-444f-bb98-260afbbab4ef tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8161d30>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:39.244758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a6726c34-205b-444f-bb98-260afbbab4ef tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.057516 Aug 18 17:12:39.245420 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 22/43] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:39 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:39.438258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5d299697-57f8-4036-b5b1-a19f723bd813 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:39.440348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5d299697-57f8-4036-b5b1-a19f723bd813 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:39.529589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:39.530209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:39.541028 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:39.552874 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:39.554658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:39.555800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:39.557198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:39.558356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:39.588470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5d299697-57f8-4036-b5b1-a19f723bd813 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.597766 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5d299697-57f8-4036-b5b1-a19f723bd813 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.600367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5d299697-57f8-4036-b5b1-a19f723bd813 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.602264 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5d299697-57f8-4036-b5b1-a19f723bd813 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1280 microversion: 2.20 time: 0.172383 Aug 18 17:12:39.603085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 22/44] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:39 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:39.704297 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6becf0e9-6878-4495-9c73-363e0c0a358f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:39.704914 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6becf0e9-6878-4495-9c73-363e0c0a358f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:39.837813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6becf0e9-6878-4495-9c73-363e0c0a358f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.870441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6becf0e9-6878-4495-9c73-363e0c0a358f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1221 microversion: 2.1 time: 0.170367 Aug 18 17:12:39.887829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 23/45] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:39 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:39.933254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.955978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-50ba8b42-fc16-49e0-8bcf-ee762b1ec96f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1211 microversion: 2.1 time: 0.430496 Aug 18 17:12:39.970349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 23/46] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:39 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1211 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:40.259565 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bf38f3e4-869d-4b37-ad03-178bd55363ee tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f81b78b0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:40.300223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bf38f3e4-869d-4b37-ad03-178bd55363ee tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.045822 Aug 18 17:12:40.301315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 24/47] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:40 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:40.629750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:40.630502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:40.644674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.645174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.646051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.646762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.647450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.648171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.717552 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.727562 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.729079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.730187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-079e0727-01d5-4d24-baad-6af0de947119 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1284 microversion: 2.20 time: 0.105919 Aug 18 17:12:40.730746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 24/48] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:40 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:40.908863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:40.909527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:40.929493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.930026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.930464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.931673 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.932139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.932657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.984810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:40.985432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:41.001855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.004087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.018813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.019847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.020340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.020785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.116569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.135686 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8a5ec3c9-c712-4931-aa0c-2eeb511d25c2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1225 microversion: 2.1 time: 0.230234 Aug 18 17:12:41.139703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 25/49] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:40 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:41.161916 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.172367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fec33a65-2958-4c35-8b60-3da07390a04b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1267 microversion: 2.1 time: 0.197711 Aug 18 17:12:41.172978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 25/50] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:40 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:41.313294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3ad9574e-cff2-4542-82b5-6e82670ef249 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8129670>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:41.348174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3ad9574e-cff2-4542-82b5-6e82670ef249 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.039010 Aug 18 17:12:41.353213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 26/51] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:41 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:41.753944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:41.754572 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:41.766679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.771625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.771625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.771625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.773043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.773802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.844211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.853504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.855426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.857457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c2d9bcf3-60bb-444b-b9ba-336ba0c4305a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1284 microversion: 2.20 time: 0.108228 Aug 18 17:12:41.868849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 26/52] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:41 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:42.159824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:42.161204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:42.180500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.187406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.187406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.187406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.188962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.189823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.193551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:42.195635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:42.201753 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.202305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.202961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.204157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.205172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.205778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.308433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.311175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.316082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-785265e6-21fe-4606-ac4c-85b146d241d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1225 microversion: 2.1 time: 0.160114 Aug 18 17:12:42.316839 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 27/53] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:42 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:42.319312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6fb2f8ba-8655-4a57-a6a4-ed81ff2795b3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1267 microversion: 2.1 time: 0.129865 Aug 18 17:12:42.320236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 27/54] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:42 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:42.363035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4e377bd5-4955-4808-87e4-1a54200ac7e6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8131040>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:42.398728 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4e377bd5-4955-4808-87e4-1a54200ac7e6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.039334 Aug 18 17:12:42.399436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 28/55] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:42 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:42.882474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:42.883184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:42.889149 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.889786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.890234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.891601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.891601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.891966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.958860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.968993 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.970502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.971630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9c33ac03-3472-4f47-b4c5-16af29bf5614 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1284 microversion: 2.20 time: 0.094198 Aug 18 17:12:42.972505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 28/56] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:42 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:43.336909 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:43.337527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:43.341387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:43.342309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:43.343993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.344704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.345149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.346003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.346466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.346894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.350534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.351052 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.351491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.352263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.352683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.353111 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.420679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:43.437485 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:43.452057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dce65bb0-ce18-4d31-9de3-9d8fa0be8a59 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1267 microversion: 2.1 time: 0.116152 Aug 18 17:12:43.452640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 29/57] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:43 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:43.454465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-852a5b97-a05f-44e9-852c-efdaa951425e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1217 microversion: 2.1 time: 0.121596 Aug 18 17:12:43.463886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-130beb0d-c9df-4e58-9fa0-537d6f601e63 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f804e9d0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:43.468107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 29/58] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:43 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:43.961032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-130beb0d-c9df-4e58-9fa0-537d6f601e63 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 200 len: 286 microversion: 2.1 time: 0.507107 Aug 18 17:12:43.966342 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 30/59] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:43 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 286 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:43.994967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:44.003579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:44.003579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.003579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.003579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.004316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.004316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.004316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.071210 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.080406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.081999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.085965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8ee9926e-ef91-49a9-b342-e9dc78eaadc9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1276 microversion: 2.20 time: 0.093153 Aug 18 17:12:44.085965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 30/60] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:43 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:44.473840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:44.474585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:44.476025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:44.476693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:44.481330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.482052 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.482491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.482706 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.483210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.483325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.483734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.483836 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.484085 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.484369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.484829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.485328 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.562743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.568043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1bc26794-239e-4553-95fe-13b2d25bb1f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1275 microversion: 2.1 time: 0.098246 Aug 18 17:12:44.568684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 31/61] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:44 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:44.575481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.583173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9a73ee9f-9f06-48ba-a15d-1ce3d2ae6539 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1273 microversion: 2.1 time: 0.111398 Aug 18 17:12:44.583749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 31/62] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:44 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:44.973794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-421c7155-0548-4491-bbf8-d8a9985848df tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f804e310>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.022748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-421c7155-0548-4491-bbf8-d8a9985848df tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] HTTP exception thrown: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-421c7155-0548-4491-bbf8-d8a9985848df tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Request method failure captured: Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 HTTP/1.1 Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nLzN7nwO32XWVhqiJ7wHHupFdQrZzslnTJo0pX92ivnSSuqPHvTc7wb6MtgZQsj0W75UGsG-Px8gBSVt5Sh16GDDGQKqIPUiu1ZrUeRltg8WlQmGtI5zqvqH1-VQ4AjNmYAJOy3zwINrGFLp491l41p4nkgBzu2f7QbC869JT-a6ZI Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:12:45.027872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 1db2791b42554d468e3bae04b0253ace Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '88604de5-2070-4c1d-948b-79415a9c0aa3'} Aug 18 17:12:45.029210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. (HTTP 404) (Request-ID: req-a7304907-cb3d-4672-9bc1-d3193c26a15f) Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.030226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:45.031618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 17:12:45.033641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. Aug 18 17:12:45.036227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:45.039903 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-421c7155-0548-4491-bbf8-d8a9985848df tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Returning 404 to user: Snapshot 88604de5-2070-4c1d-948b-79415a9c0aa3 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:45.040990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-421c7155-0548-4491-bbf8-d8a9985848df tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3" status: 404 len: 111 microversion: 2.1 time: 0.071246 Aug 18 17:12:45.042215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 32/63] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 17:12:44 2022] GET /compute/v2.1/os-snapshots/88604de5-2070-4c1d-948b-79415a9c0aa3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:45.060264 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7da913f0-1832-4e6a-8822-2e194c9e5fe1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f80c9160>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.107914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.109898 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:45.125965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.127468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.128905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.135057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.135668 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.136906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.415051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7da913f0-1832-4e6a-8822-2e194c9e5fe1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 202 len: 0 microversion: 2.1 time: 0.367841 Aug 18 17:12:45.415637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 32/64] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:12:45 2022] DELETE /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:12:45.444828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b9b53718-b1cc-43f4-a5cd-a8f935b490d4 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8129550>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.579574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.591254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.592924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.593999 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-42d59a57-ecba-44b0-8e02-b04df8ec59ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1340 microversion: 2.20 time: 0.491037 Aug 18 17:12:45.595029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 33/65] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1340 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:45.599866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.601717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:45.610741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.611465 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.612093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.612982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.613612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.614395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.614942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b9b53718-b1cc-43f4-a5cd-a8f935b490d4 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 200 len: 344 microversion: 2.1 time: 0.189228 Aug 18 17:12:45.624508 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 33/66] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 344 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:45.649930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.651394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:45.701632 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.702137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.708959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.713750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.714248 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.714696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.727286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.740006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7f917ca2-4aad-4d89-a9a3-e40819943d52 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1273 microversion: 2.1 time: 0.142482 Aug 18 17:12:45.742854 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 34/67] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:45.930109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.944538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9c671977-6ddd-4c0a-a98a-8200b1e67f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1279 microversion: 2.1 time: 0.320142 Aug 18 17:12:45.962990 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 34/68] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1279 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:46.619000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:46.620355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:46.633090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1ca9d4db-e2ed-4beb-8f5f-352e4dcb34b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f8131310>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:46.691381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.691381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.691381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.691381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.691795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.691795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.798123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-1ca9d4db-e2ed-4beb-8f5f-352e4dcb34b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] HTTP exception thrown: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1ca9d4db-e2ed-4beb-8f5f-352e4dcb34b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Request method failure captured: Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f HTTP/1.1 Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nLzN7nwO32XWVhqiJ7wHHupFdQrZzslnTJo0pX92ivnSSuqPHvTc7wb6MtgZQsj0W75UGsG-Px8gBSVt5Sh16GDDGQKqIPUiu1ZrUeRltg8WlQmGtI5zqvqH1-VQ4AjNmYAJOy3zwINrGFLp491l41p4nkgBzu2f7QbC869JT-a6ZI Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:12:46.800321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 1db2791b42554d468e3bae04b0253ace Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'bd14625f-bab2-4263-bfd0-5f910a9c531f'} Aug 18 17:12:46.804953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. (HTTP 404) (Request-ID: req-1213863c-0357-4fc9-bca8-4630296f2c3b) Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:46.805712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:46.806687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:12:46.807623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1ca9d4db-e2ed-4beb-8f5f-352e4dcb34b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Returning 404 to user: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:46.808563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1ca9d4db-e2ed-4beb-8f5f-352e4dcb34b6 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 404 len: 109 microversion: 2.1 time: 0.173517 Aug 18 17:12:46.812038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 35/69] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:46 2022] GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:46.817075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:46.831165 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:46.866613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.866613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.866613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.866613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.867381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.867381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.178921 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.189489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.195415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.200385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-32666f13-e477-48f8-b789-82a04a91cecb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1338 microversion: 2.20 time: 0.585792 Aug 18 17:12:47.206977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 35/70] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:46 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1338 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:47.217943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ae9ffe6d-ecde-458a-a551-d52863dc14e1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f80d7550>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:47.474549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.498368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3cad387e-fab8-4e8b-b3d6-ce926c1d67e9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.685122 Aug 18 17:12:47.499239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 36/71] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:46 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:47.504098 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:47.504893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:47.514939 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.514939 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.514939 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.514939 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.515345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.515345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.559031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-ae9ffe6d-ecde-458a-a551-d52863dc14e1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] HTTP exception thrown: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ae9ffe6d-ecde-458a-a551-d52863dc14e1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Request method failure captured: Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f HTTP/1.1 Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nLzN7nwO32XWVhqiJ7wHHupFdQrZzslnTJo0pX92ivnSSuqPHvTc7wb6MtgZQsj0W75UGsG-Px8gBSVt5Sh16GDDGQKqIPUiu1ZrUeRltg8WlQmGtI5zqvqH1-VQ4AjNmYAJOy3zwINrGFLp491l41p4nkgBzu2f7QbC869JT-a6ZI Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:12:47.561043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 1db2791b42554d468e3bae04b0253ace Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'bd14625f-bab2-4263-bfd0-5f910a9c531f'} Aug 18 17:12:47.562305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. (HTTP 404) (Request-ID: req-5d3c4923-94c3-4a87-b2c2-7e98b73f5c5d) Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:47.563305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:12:47.564280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 17:12:47.565229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ae9ffe6d-ecde-458a-a551-d52863dc14e1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Returning 404 to user: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ae9ffe6d-ecde-458a-a551-d52863dc14e1 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 404 len: 109 microversion: 2.1 time: 0.355705 Aug 18 17:12:47.566163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 36/72] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:12:47 2022] DELETE /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 109 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:47.572459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78b6c087-ae56-46e9-a181-8013709c3501 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Calling method '.version_select at 0x7fd1f80a4ee0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:47.617161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.625560 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ef2db358-1d6a-4ca4-a34d-4d780bec7830 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1279 microversion: 2.1 time: 0.125043 Aug 18 17:12:47.627112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 37/73] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:47 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:47.654835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-78b6c087-ae56-46e9-a181-8013709c3501 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] HTTP exception thrown: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78b6c087-ae56-46e9-a181-8013709c3501 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Request method failure captured: Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f HTTP/1.1 Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nLzN7nwO32XWVhqiJ7wHHupFdQrZzslnTJo0pX92ivnSSuqPHvTc7wb6MtgZQsj0W75UGsG-Px8gBSVt5Sh16GDDGQKqIPUiu1ZrUeRltg8WlQmGtI5zqvqH1-VQ4AjNmYAJOy3zwINrGFLp491l41p4nkgBzu2f7QbC869JT-a6ZI Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:12:47.661641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/07918f455d114a719fd4b7742348e1b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 07918f455d114a719fd4b7742348e1b9 Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1140644668 Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 1db2791b42554d468e3bae04b0253ace Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1140644668-project Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'bd14625f-bab2-4263-bfd0-5f910a9c531f'} Aug 18 17:12:47.664133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. (HTTP 404) (Request-ID: req-204d36bc-359d-4a09-a225-34b921854536) Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:47.664912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:12:47.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:12:47.667895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78b6c087-ae56-46e9-a181-8013709c3501 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] Returning 404 to user: Volume bd14625f-bab2-4263-bfd0-5f910a9c531f could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-78b6c087-ae56-46e9-a181-8013709c3501 tempest-VolumesSnapshotsTestJSON-1140644668 tempest-VolumesSnapshotsTestJSON-1140644668-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f" status: 404 len: 109 microversion: 2.1 time: 0.089514 Aug 18 17:12:47.669051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 37/74] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:12:47 2022] GET /compute/v2.1/os-volumes/bd14625f-bab2-4263-bfd0-5f910a9c531f => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:12:48.242232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:48.245484 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:48.247607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=4 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:48.263901 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.264410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.264855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.265587 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.266040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.266462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.469695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.480512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.482038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.483743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3be15837-1c60-40c0-a452-f8fe0f4da396 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.252516 Aug 18 17:12:48.499189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 38/75] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:48 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:48.517261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=4 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:48.518422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=22 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:48.523552 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:48.524351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:48.538749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.539603 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.540346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.541292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.541959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.542871 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.651481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:48.652105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:48.666573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.668209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.670425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.670425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.670425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.670425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.846961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.867270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c4cb3ec1-177b-43d7-9cf6-bfdd1b78d5ed tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.351738 Aug 18 17:12:48.868095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 38/76] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:48 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:49.003818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:49.013856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-080df3c6-89b6-44b6-aebe-a6b8480cd259 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.367524 Aug 18 17:12:49.014239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e590ac9-d3f2-4279-aba4-d75780182977", "tag": "82e703d0-eff7-4aa8-b74e-aa30f2ed3ac1"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:49.033044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 39/77] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:48 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:49.033254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.033758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.034149 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.056257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Creating event network-changed:82e703d0-eff7-4aa8-b74e-aa30f2ed3ac1 for instance 1e590ac9-d3f2-4279-aba4-d75780182977 on hv-cinder-85367 Aug 18 17:12:49.057154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 17:12:49.057703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-58baf320-acd8-44da-925a-7b8f0bd6f9bc req-261ebfc9-8ef7-44e1-b534-dc4f1e26a4a6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 17:12:49.059210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.063021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.063021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.063021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.063021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.063021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.075641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.compute.rpcapi [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 17:12:49.076956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] Releasing lock "compute-rpcapi-router" {{(pid=121216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 17:12:49.105451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5f1e0169-fb33-44f4-aced-9ec30a4828dd None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213049 Aug 18 17:12:49.106454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 39/78] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:49.506307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:49.507033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:49.512952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.513424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.513871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.514532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.515005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.515425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.662789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:49.672236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:49.673733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:49.674841 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b98783ee-803e-4053-8316-0a5f193bd44e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.172555 Aug 18 17:12:49.675424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 40/79] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:49 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:49.890763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:49.891621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:49.901127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.902155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.902810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.904036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.904665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.905314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.040599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:50.041284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:50.043174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=22 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:50.053035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.053200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.053200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.053716 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.054598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.055234 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.055628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.059455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d70e4e2b-0522-4341-a88e-3cc7575178eb tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.173595 Aug 18 17:12:50.060330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 40/80] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:49 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:50.371943 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.380621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-53c003c3-58e8-4463-8c50-61994a72d00d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.344054 Aug 18 17:12:50.382480 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 41/81] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:50 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:50.698219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:50.698826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:50.704796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.705272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.705710 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.706411 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.706862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.707488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.852894 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.863143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.866004 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.867768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cc69133a-ab02-464b-af76-5060c547446f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.173214 Aug 18 17:12:50.868954 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 41/82] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:50 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:51.082501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:51.082501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:51.090373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.090862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.091342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.092172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.092497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.092918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.232716 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:51.244131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a5e4f423-475b-4f1b-b5bc-36d6e0e1daf3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.167993 Aug 18 17:12:51.244830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 42/83] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:51 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:51.402620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:51.403478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:51.411488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.420176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.420176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.420176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.420176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.420578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.563934 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:51.573598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a80cb1ce-ffc4-46a2-8759-b54f9b4e40ec tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.174309 Aug 18 17:12:51.574947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 42/84] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:51 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:51.893133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:51.894196 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:51.901237 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.903621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.903621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.903621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.903621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.903968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.080649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.087685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.090326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.091717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-89f35f04-b5de-4e52-9da1-d73f2cdb2560 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.202392 Aug 18 17:12:52.092868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 43/85] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:51 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:52.275645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:52.275645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:52.275645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.275645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.276065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.276065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.276292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.276905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.282305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:52.429300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.438554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-776e38a0-810e-4854-9a0d-32eaa5c00a0d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.176591 Aug 18 17:12:52.439687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 43/86] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:52 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:52.595612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:52.596223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:52.608059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.608059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.608059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.608059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.608451 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.608451 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.744706 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.752594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-afe8d034-c168-498d-bfde-a6313f1a8e45 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.160691 Aug 18 17:12:52.753249 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 44/87] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:52 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:53.119945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.120608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.126673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.127183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.127623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.128320 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.128773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.129203 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.262121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.270420 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.271943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.273065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b6d5a0be-2a53-4311-9c8e-26f6fc8dbb2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.158306 Aug 18 17:12:53.273615 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 44/88] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:53.461280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.461872 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.467857 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.468591 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.474583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.476267 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.476923 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.477410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.682354 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.685863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:53.690469 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bb3bc3f9-34b4-4075-ae0c-c0c0bcfb9f56 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.233323 Aug 18 17:12:53.704482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 45/89] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:53.773622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.774271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.780268 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.780750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.781189 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.781884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.782328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.782745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.927897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.936476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-80c3fab5-2745-475d-8549-d93adbd4dc7e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.166740 Aug 18 17:12:53.937310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 45/90] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:54.310425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:54.310425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:54.323785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.327531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.328230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.331462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.333228 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.338672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.490496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:54.499513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:54.501026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:54.502168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a5a605d3-40c9-4e51-8d5a-7ef5da9a45cb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.202375 Aug 18 17:12:54.502726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 46/91] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:54 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:54.711601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:54.712776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:54.719368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.720097 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.720704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.721479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.722281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.722726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.877032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:54.884804 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-21c686b3-d537-43a4-b938-6737682cd5e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.177649 Aug 18 17:12:54.885401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 46/92] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:54 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:54.957595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:54.958221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:54.964338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.965009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.965324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.966064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.966529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.966971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:55.118763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:55.126148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2bf04832-51e8-4a7e-91d3-3c31b2d27564 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.172370 Aug 18 17:12:55.127260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 47/93] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:54 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:55.530782 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:55.531757 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:55.538274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:55.547560 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:55.549431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:55.549431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:55.549431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:55.550088 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:55.550582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:55.733987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:55.745566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:55.763031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:55.763031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e6db5b22-a832-4cfe-8602-0b6a7f2c8930 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.226524 Aug 18 17:12:55.763031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 47/94] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:55 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:55.905679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:55.906623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:55.917792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:55.919885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:55.920745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:55.922033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:55.922652 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:55.923521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.070459 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:56.078833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7154d7ba-20c7-4a8e-be03-e9c76aa9a44a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.177840 Aug 18 17:12:56.081175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 48/95] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:55 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:56.148997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:56.150600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:56.165666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.166534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.167099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.174241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.174241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.174241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.357922 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:56.381951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d44b7a18-a7be-4562-a5db-71881e344fe2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.227809 Aug 18 17:12:56.381951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 48/96] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:56 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:56.781310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:56.783372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:56.793178 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.793886 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.794410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.795254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.795833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.796746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.003271 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.018763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.032615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.033799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e935ea34-2b22-4911-9bed-8fec1162f81b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.256643 Aug 18 17:12:57.034353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 49/97] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:56 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:57.101898 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:57.103124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:57.117904 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.121786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.121786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.121786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.121786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.122124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.315448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.327040 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6a071222-60f0-483c-8003-8c37929bb76a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.230585 Aug 18 17:12:57.341701 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 49/98] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:57 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:57.393496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:57.394596 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:57.403095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.409357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.409357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.410135 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.410615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.411081 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.574532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.591393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4f42301d-0184-4072-9ab3-8836c3b09815 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.199306 Aug 18 17:12:57.591393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 50/99] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:57 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:58.060409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.061174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:58.067629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.068114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.068608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.069820 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.070272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.070698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.232348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.247212 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.250071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.251658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-db525df6-e0a0-4e04-a25c-a4161999d57f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.195142 Aug 18 17:12:58.264161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 50/100] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:58 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:58.348391 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.349029 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:58.355051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.355531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.355965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.356688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.357429 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.357859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.493466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.504212 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-902db2ac-a768-49d1-9750-b5250fdee59a tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.159614 Aug 18 17:12:58.504817 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 51/101] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:58 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:58.611518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.619020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:58.632708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.633273 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.633779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.640711 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.641197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.641636 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.839838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.849120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-710983f7-762c-4b2e-b969-27b444b6e7e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.241773 Aug 18 17:12:58.850952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 51/102] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:58 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:59.276316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:59.276858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:59.283066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.283556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.283996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.284701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.285160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.285589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.463921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:59.472636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:59.474249 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:59.476065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-de11e8f8-db9b-49c7-8adb-cb0ecebc55c4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.204978 Aug 18 17:12:59.476730 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 52/103] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:59 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:59.525863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:59.526619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:59.528408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:59.533068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.534077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.534077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.534654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.535158 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.535583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.792634 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:59.801318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8ceee6ec-ca4a-4202-b412-31738ee301b0 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.279534 Aug 18 17:12:59.815009 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 52/104] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:59 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:59.876324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:59.876433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:59.881608 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:59.885875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.886562 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.887182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.888243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.888998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.889594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.055857 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:00.059079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e390d1a2-14d1-42d7-8710-4784238ab01e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.189849 Aug 18 17:13:00.059892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 53/105] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:59 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:00.500361 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:00.500970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:00.507207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.507689 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.508117 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.508822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.509266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.509688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.695907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:00.716618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:00.721758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:00.724115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e176bd19-bd47-43b4-a76f-58ec2900bda6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.227625 Aug 18 17:13:00.727221 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 53/106] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:00 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:00.823338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:00.826310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:00.833585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.835302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.835966 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.836881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.837478 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.838064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.007477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:01.015762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-91bc4d06-ee46-42cb-8bfb-eef074bf9fb2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.197375 Aug 18 17:13:01.029345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 54/107] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:00 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:01.083205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:01.084716 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:01.091977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.092983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.093419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.094293 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.095214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.095640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.265265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:01.279123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-afa9c096-035e-4918-82b1-00da4ea1f067 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.199905 Aug 18 17:13:01.279123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 54/108] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:01 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:01.749314 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:01.750488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:01.758695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.759343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.759974 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.760674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.761123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.761536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.025307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.042461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.043184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.059676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.063605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.073444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.073444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.073444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.073444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.073873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.073873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.077425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a364b101-e15e-4540-b1f1-f94a9db146a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.332150 Aug 18 17:13:02.100541 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 55/109] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:01 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:02.274666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.283783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-594e8db6-e63d-4cff-b0a5-52f7acdc8130 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.249911 Aug 18 17:13:02.284236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 55/110] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:02 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:02.299227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.299828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.306303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.306780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.307240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.307936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.308384 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.308800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.476160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.484828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2df3cd06-5f3b-4f23-bfdb-0e5653c8ae20 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.189756 Aug 18 17:13:02.485408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 56/111] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:02 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:03.121129 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.121960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.129055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.129695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.132032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.132032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.132525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.133228 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.262890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.274323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.274323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.274928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-eee81c2c-2a5f-468c-9591-a7b4a33e129b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.157650 Aug 18 17:13:03.275489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 56/112] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:03.306080 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.306695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.315317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.315317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.315317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.315317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.315638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.315638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.458049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.465989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a6663e9a-8b0b-401e-8a34-b11a26e70b19 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.164249 Aug 18 17:13:03.466694 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 57/113] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:03.505667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.506851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.513448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.514115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.514568 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.515311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.515767 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.518206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.650362 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.658244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f58a9043-4099-46a4-a372-b0d6dcad7965 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.156434 Aug 18 17:13:03.658819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 57/114] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:04.297953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:04.298558 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:04.305179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.305667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.306095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.306795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.307286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.307710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.486449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:04.487106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:04.500250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.500250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.500250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.500250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.502522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.503022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.910873 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:04.921491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:04.923423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:04.924688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c4a04b97-9cf4-4dc2-b435-ae1bc47bd916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.631394 Aug 18 17:13:04.925365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 58/115] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:04 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:04.931518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:04.932473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:04.939095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.939934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.940748 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.942095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.948387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.951921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.292467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:05.300404 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-abbb8af2-f3ae-4cca-9596-b9ca145e738e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.817582 Aug 18 17:13:05.301199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 58/116] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:04 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:05.566840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:05.575823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9ac94c78-67ae-401e-a2c2-9b72f67ce025 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.649223 Aug 18 17:13:05.576474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 59/117] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:04 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:05.949630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:05.951015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:05.956875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:05.957574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:05.958007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.959442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:05.959923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:05.960379 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.322244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:06.322858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:06.328708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.329182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.329613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.330302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.330751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.331214 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.436307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.440079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:06.446591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.448155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.449259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-03857a47-18c4-43a2-b4a5-8f618c608832 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.503774 Aug 18 17:13:06.449815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 59/118] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:05 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:06.597015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:06.597653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:06.603956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.604442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.604878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.605163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.605624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.606008 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.606427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.613153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d1bf1e71-7402-403e-8fae-845e48a56582 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.295328 Aug 18 17:13:06.613720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 60/119] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:06 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:07.067210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.077471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3608ff9-97d3-4e38-8212-c21692a8cbd3", "tag": "73e88f96-7c98-425d-8b5c-16175cefe3de"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:07.080116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c0d2193b-332b-404c-a003-79444a13a2ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.487164 Aug 18 17:13:07.080707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 60/120] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:06 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:07.090935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.091403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.091823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.115446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Creating event network-changed:73e88f96-7c98-425d-8b5c-16175cefe3de for instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 on hv-cinder-85367 Aug 18 17:13:07.116534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 17:13:07.117132 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ba82e572-26ee-4626-b500-219b8d11f0ee req-9ece59ad-44ea-4954-ad90-a70b4cb7b2f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 17:13:07.118933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.119394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.119822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.120533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.120979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.121395 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.132965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.compute.rpcapi [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 17:13:07.133843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] Releasing lock "compute-rpcapi-router" {{(pid=121217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 17:13:07.150609 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4bbfbbff-e860-448e-8a66-4176336fc1cd None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136369 Aug 18 17:13:07.151381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 61/121] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:13:07.471549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:07.472188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:07.478733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.479246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.479676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.480368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.480817 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.481238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.610413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.619217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.620761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.621857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2c4816ea-06c8-46a9-9409-60a31217dfb1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.154205 Aug 18 17:13:07.622407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 61/122] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:07 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:07.635122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:07.635815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:07.641842 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.642317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.642747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.643457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.643907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.644326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.776141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.779634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:07.784085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-06b1a398-9f5b-4713-8aaf-3fb8d6f686b5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.153172 Aug 18 17:13:07.784653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 62/123] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:07 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:08.101415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:08.102025 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:08.107885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.108361 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.108791 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.109470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.109924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.110328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.240678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:08.248387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b23d833f-d973-4517-9af6-8eaaeb0cc656 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.151631 Aug 18 17:13:08.248940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 62/124] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:08 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:08.643947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:08.644553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:08.651333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.651805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.652233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.652909 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.653355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.653771 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.806009 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:08.806614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:08.812725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.813193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.813617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.814368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.814754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.815195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.976563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:08.985791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:08.987394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:08.988703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-29c0c993-356e-4cc1-8ed8-6434dae8f103 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.348564 Aug 18 17:13:08.989441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 63/125] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:08 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:09.015122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:09.023090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3948270a-073b-4a44-950b-3e12f6e9b1ef tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.221714 Aug 18 17:13:09.023655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 63/126] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:08 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:09.166653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}, {"name": "network-changed", "server_uuid": "41f96a52-4974-4053-bbf5-4719d7be5671", "tag": "2804c6c6-54ad-4beb-995c-9d13bb1213db"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:09.176892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:09.178285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:09.178710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:09.195293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] Creating event network-changed:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:13:09.195293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] Creating event network-changed:2804c6c6-54ad-4beb-995c-9d13bb1213db for instance 41f96a52-4974-4053-bbf5-4719d7be5671 on hv-cinder-85367 Aug 18 17:13:09.198858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-0a6f1ee7-bd64-497c-8683-8fabd92742bd req-07e723f4-29f2-4fe2-9024-0afbe6ea3750 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035995 Aug 18 17:13:09.199466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 64/127] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:09.284197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:09.284197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:09.287406 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:09.288193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:09.288698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:09.289499 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:09.290096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:09.290589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:09.832739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:09.841498 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2fc87290-6cda-4b16-b495-5be3769b643a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.569137 Aug 18 17:13:09.845526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 64/128] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:09 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:10.023285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:10.025069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:10.030663 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.031263 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.032236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.032746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.033390 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.033987 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.043370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:10.043993 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:10.051092 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.053069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.053758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.054942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.055634 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.056207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.252420 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:10.256207 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:10.261202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1ab8b095-9afa-447e-ada9-a39b4253c1b7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.221592 Aug 18 17:13:10.261974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 65/129] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:10 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:10.264823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:10.266386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:10.267705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ec8d1d13-e9a4-437d-9206-4ee6ef6fd247 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.250663 Aug 18 17:13:10.268397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 65/130] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:10 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:10.861846 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:10.862455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:10.869131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.873297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.873297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.873297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.873297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.873666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:11.177932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:11.186853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-42c7dd0c-df5d-4897-bdbf-8668ebee9bbb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.327744 Aug 18 17:13:11.186853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 66/131] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:10 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:11.282108 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:11.282717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:11.289471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:11.289964 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:11.290317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:11.290465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:11.290950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:11.291197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:11.291650 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:11.292069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:11.297189 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:11.297673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:11.298101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:11.298788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:11.299268 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:11.299692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:11.498940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:11.503175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:11.513869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:11.515445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:11.516024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7b0df08a-b354-415f-b1c9-01ef960d8ea7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.237726 Aug 18 17:13:11.516784 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c52a1229-3548-4349-9f15-817700b29d2b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.230868 Aug 18 17:13:11.518944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 66/132] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:11 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:11.532951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 67/133] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:11 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:12.208582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:12.211103 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:12.218119 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:12.218599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:12.219063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:12.219759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:12.220231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:12.220730 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:12.371504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:12.379138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4c5c8f05-584f-44bd-89b6-bc07fcfd4291 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.175793 Aug 18 17:13:12.379754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 67/134] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:12 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:12.537951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:12.538569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:12.541635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:12.542359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:12.545577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:12.546065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:12.546678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:12.547428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:12.548337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:12.548778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:12.549188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:12.552827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:12.552827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:12.552827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:12.552827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:12.553089 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:12.751794 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:12.756599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:12.760706 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:12.762740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:12.763891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2cc8d3f3-711d-4d18-8951-30883fa4e563 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.228043 Aug 18 17:13:12.764336 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2be9829c-cfab-4510-ac69-392f2f543375 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.230953 Aug 18 17:13:12.764435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 68/135] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:12 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:12.767536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 68/136] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:12 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:13.399894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:13.400529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:13.406397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:13.406874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:13.407338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:13.408023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:13.408471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:13.408894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:13.540250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:13.548010 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6211e514-6ae4-4411-9ecb-064920f26418 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.151906 Aug 18 17:13:13.548561 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 69/137] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:13 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:13.787830 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:13.788369 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:13.794393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:13.795165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:13.795594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:13.796281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:13.796722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:13.797143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:13.800756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:13.801366 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:13.808268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:13.808743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:13.809172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:13.809857 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:13.810303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:13.810732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:14.002328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:14.005965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:14.012265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:14.013969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:14.014519 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fba189b7-aa3a-4128-aad0-81d5c2dd606e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.217424 Aug 18 17:13:14.015172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a19bb93c-1364-4778-b9c7-286ec4cb8f96 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.232105 Aug 18 17:13:14.015470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 70/138] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:13 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:14.022113 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 69/139] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:13 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:14.569819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:14.570425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:14.576356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:14.576828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:14.577252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:14.577927 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:14.578369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:14.578784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:14.707105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:14.714913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-65bfd3e0-1ff3-4992-bef6-2ce9cca2e1bc tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.149568 Aug 18 17:13:14.715473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 71/140] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:14 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:15.036873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:15.037753 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:15.047500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:15.047500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:15.047677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:15.047677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:15.047677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:15.047677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:15.048260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:15.048739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:15.050705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:15.051204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:15.052265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:15.053003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:15.053456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:15.053875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:15.245115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:15.248235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:15.253004 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2d808408-fe21-43df-8a64-8be57761be1d tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.221275 Aug 18 17:13:15.253577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 70/141] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:15 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:15.257520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:15.259144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:15.260310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b2964f38-ca97-4264-94e3-fa766eca2550 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.220528 Aug 18 17:13:15.261091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 72/142] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:15 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:15.734919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:15.735573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:15.742326 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:15.742801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:15.743262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:15.743949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:15.744397 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:15.744818 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:15.877223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:15.885525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9b703d91-e13e-4c86-97a6-7c0b11bda2d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.154411 Aug 18 17:13:15.886089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 71/143] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:15 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:16.273904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:16.274437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:16.280309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:16.280786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:16.281216 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:16.281889 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:16.282334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:16.282748 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:16.289387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:16.289990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:16.296149 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:16.296667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:16.297105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:16.297798 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:16.298248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:16.298670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:16.465664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:16.474072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bb845e58-6b70-49ac-8f3d-0a578319e8c5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.203604 Aug 18 17:13:16.474920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 73/144] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:16 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:16.487080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:16.496275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:16.497766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:16.498855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c52f6063-01e3-44a2-899c-83ec1b513d56 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.213467 Aug 18 17:13:16.499433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 72/145] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:16 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:16.907099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:16.907715 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:16.914319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:16.914800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:16.915254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:16.915948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:16.916401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:16.916821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:17.048023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:17.055659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fe740661-661d-4826-9a0a-4d5e0dabb995 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.152543 Aug 18 17:13:17.056219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 74/146] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:16 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:17.495134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:17.495745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:17.507760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:17.508238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:17.508665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:17.509353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:17.509800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:17.510219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:17.522235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:17.522982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:17.524949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:17.529657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:17.530142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:17.530575 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:17.531300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:17.531755 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:17.532181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:17.695176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:17.702744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a1a1fa90-d447-4dbf-9d32-5e7c93414fc2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.211435 Aug 18 17:13:17.703347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 73/147] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:17 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:17.717544 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:17.725644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:17.727260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:17.728358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-228dc43a-8ef0-4a44-9585-3af6ef83bce7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.210882 Aug 18 17:13:17.728918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 75/148] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:17 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:18.075488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:18.076097 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:18.082130 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:18.082645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:18.083274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:18.083973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:18.084425 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:18.084851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:18.217896 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:18.226192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-947324c3-b8ef-4a72-b77b-d97275d38629 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.154493 Aug 18 17:13:18.226748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 74/149] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:18 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:18.723363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:18.723989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:18.729910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:18.735979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:18.735979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:18.735979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:18.735979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:18.736379 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:18.750857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:18.751567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:18.758413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:18.758888 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:18.759340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:18.760023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:18.760468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:18.760997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:18.930077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:18.936896 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:18.937665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4bacb610-ed25-4dc3-9d6c-20fa9db1f5ff tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.218087 Aug 18 17:13:18.938240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 76/150] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:18 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:18.946155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:18.947799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:18.948863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a748b9a9-7e16-4344-a3a6-d004a1831ccb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.201764 Aug 18 17:13:18.949400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 75/151] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:18 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:19.248355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:19.249142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:19.256399 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:19.256892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:19.257320 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:19.258046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:19.258495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:19.258931 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:19.394698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:19.402784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f0fd225d-1625-4f7b-b994-806bd27255d2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.159139 Aug 18 17:13:19.403408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 77/152] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:19 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:19.959529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:19.960129 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:19.966154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:19.966651 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:19.967116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:19.967807 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:19.968253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:19.968676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:19.971365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:19.972011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:19.978594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:19.979110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:19.979537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:19.980220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:19.980666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:19.981085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:19.987360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:20.160246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:20.168676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-96c6a9ad-9f55-4661-befa-d92f988bac7e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.213763 Aug 18 17:13:20.169243 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 76/153] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:19 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:20.173091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:20.181349 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:20.182830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:20.183954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a7bf48da-d6cf-4f64-b6a6-baa11c377c6a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.216465 Aug 18 17:13:20.184528 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 78/154] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:19 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:20.424514 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:20.425121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:20.433588 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:20.434080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:20.434631 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:20.435488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:20.435859 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:20.436305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:20.569604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:20.577218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6e596918-1ad4-4ad5-9429-7d329f14a2d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.156574 Aug 18 17:13:20.577781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 77/155] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:20 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:21.188972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:21.189576 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:21.196008 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:21.196481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:21.196908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:21.197585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:21.198030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:21.198446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:21.206842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:21.208145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:21.214109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:21.214593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:21.215055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:21.215755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:21.216215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:21.216649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:21.393680 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:21.400679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:21.402600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b8e3e0f3-1142-4e95-babb-c85adb31e95b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.217368 Aug 18 17:13:21.414965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 79/156] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:21 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:21.421519 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:21.423103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:21.424347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dd099b71-f552-4734-b8c9-62a4a23d19ff tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.221393 Aug 18 17:13:21.424945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 78/157] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:21 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:21.598123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:21.598736 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:21.604583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:21.605061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:21.605492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:21.606172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:21.606620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:21.607073 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:21.610912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:21.733501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:21.741659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9704ec0b-a2b2-4578-9218-101865b91bc1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.147464 Aug 18 17:13:21.742218 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 80/158] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:21 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:22.423786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:22.424549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:22.430969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:22.431453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:22.431890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:22.432581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:22.433035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:22.433456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:22.448473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:22.450377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:22.462788 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:22.463665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:22.464444 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:22.465466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:22.466645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:22.467238 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:22.948569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:22.956925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-64fa66d6-a35c-4ea8-a0ca-d0174577e358 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.536852 Aug 18 17:13:22.958014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 79/159] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:22 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:22.963268 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:22.963398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:22.964125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:22.972513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:22.976677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:22.977927 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-821a8afa-f4d1-451c-a37b-cf614b16311d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.533343 Aug 18 17:13:22.979318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:22.979857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:22.980463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:22.981163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:22.981612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:22.982173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:22.983162 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 81/160] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:22 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:23.111226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:23.119007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-21115902-f437-45c3-8d46-6be271b1b3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.159350 Aug 18 17:13:23.119567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 80/161] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:22 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:23.980006 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:23.980616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:23.986614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:23.987118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:23.987591 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:23.993035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:23.993035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:23.993035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.001037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:24.002422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:24.010923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.011432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.012280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.012988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.013447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.014127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.211585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.211585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0c5b3374-9a6a-407d-9069-52526869936e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.235560 Aug 18 17:13:24.212382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 82/162] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:23 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:24.224437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:24.225129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:24.229872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.234420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.234944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.235526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.236406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.236755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.237325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.237933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.238306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.239946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a8c23fd1-cd6d-4cb4-bf66-6f4b8de7a1c1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.242800 Aug 18 17:13:24.255428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 81/163] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:23 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:24.458318 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.468189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9900ff50-d089-4831-a306-b9f4edf301eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.249825 Aug 18 17:13:24.482137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 83/164] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:24 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:24.507569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-55455af8-a7fd-4d43-b920-a295ac0e37f3 req-678ee5ef-9050-4263-b060-19a72ad60401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e590ac9-d3f2-4279-aba4-d75780182977", "name": "network-vif-plugged", "status": "completed", "tag": "82e703d0-eff7-4aa8-b74e-aa30f2ed3ac1"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:24.517712 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-55455af8-a7fd-4d43-b920-a295ac0e37f3 req-678ee5ef-9050-4263-b060-19a72ad60401 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.518275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-55455af8-a7fd-4d43-b920-a295ac0e37f3 req-678ee5ef-9050-4263-b060-19a72ad60401 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.518876 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-55455af8-a7fd-4d43-b920-a295ac0e37f3 req-678ee5ef-9050-4263-b060-19a72ad60401 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.533224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-55455af8-a7fd-4d43-b920-a295ac0e37f3 req-678ee5ef-9050-4263-b060-19a72ad60401 service nova] Creating event network-vif-plugged:82e703d0-eff7-4aa8-b74e-aa30f2ed3ac1 for instance 1e590ac9-d3f2-4279-aba4-d75780182977 on hv-cinder-85367 Aug 18 17:13:24.542095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-55455af8-a7fd-4d43-b920-a295ac0e37f3 req-678ee5ef-9050-4263-b060-19a72ad60401 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116376 Aug 18 17:13:24.542704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 82/165] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:13:25.236914 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:25.236914 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:25.240754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.241466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.242040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.243468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.243885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.244377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.262562 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:25.263400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:25.272687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.273545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.273973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.274877 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.275490 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.276054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.511712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.519481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-92ca07ad-dd6c-4331-9301-c6bd75ed88f3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.290634 Aug 18 17:13:25.520061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 84/166] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:25 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:25.521055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.524724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:25.525335 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:25.531171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.531649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.531859 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.532080 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.532881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.533368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.533482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.533896 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.534470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7cb51e37-9825-4ff1-a2bf-8a992731f4c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.276635 Aug 18 17:13:25.536475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 83/167] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:25 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:25.685612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.693421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d80ac5fd-b13b-4162-9818-3ea6db336f6f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.172197 Aug 18 17:13:25.693991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 85/168] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:25 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:26.542069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:26.542680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:26.544952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=73 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:26.549954 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.550437 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.551804 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.553053 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.553608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.554045 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.561216 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:26.561822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:26.568608 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.569084 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.569520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.570377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.570824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.571275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.758295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.763437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.767068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3e182fd6-9566-4642-95ae-a55d9aa140ac tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.228746 Aug 18 17:13:26.770966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 84/169] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:26 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:26.773450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:26.774058 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:26.777860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.780556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.781294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.781885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.782749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.783275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.783848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.788435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.789753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0bd72124-72ab-42d8-9c4e-be652d36921d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.232415 Aug 18 17:13:26.790428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 86/170] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:26 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:26.983036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.991195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bd9c359a-7b2b-4c77-8137-77ff9a676ad2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.222190 Aug 18 17:13:26.991768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 85/171] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:26 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:27.788460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:27.789076 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:27.795585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:27.796067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:27.796533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:27.797227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:27.797677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:27.798102 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:27.815321 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:27.816023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:27.822377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:27.822962 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:27.823463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:27.824230 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:27.824800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:27.825151 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:27.998335 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:28.006336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-03792329-0d2f-4f00-ad6f-f716d148ca9e tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.222519 Aug 18 17:13:28.007159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 87/172] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:27 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:28.012166 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:28.013168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:28.015647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:28.019317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:28.019928 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:28.020470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:28.021224 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:28.021684 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:28.022113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:28.025553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:28.027172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:28.028283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-934aef76-e798-4b77-8783-f606c3b1e522 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.216976 Aug 18 17:13:28.028842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 86/173] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:27 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:28.154827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:28.163072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1f304a2a-4445-4fee-b2fe-63b21cd7c0e3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.154784 Aug 18 17:13:28.163638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 88/174] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:28 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:29.030265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:29.030885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:29.037179 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.037658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.038090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.038791 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.039266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.039690 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.051970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:29.052641 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:29.061003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.061003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.061003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.061003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.061284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.061465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.245799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:29.253698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:29.254430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3bdee512-1804-4e7e-b332-40d51df0242f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.227729 Aug 18 17:13:29.255310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 87/175] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:29 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:29.260286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:29.261134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:29.263286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:29.264977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:29.266068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a91fd219-c32d-4d36-903d-6cf35a4ed226 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.218477 Aug 18 17:13:29.266774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 89/176] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:29 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:29.267176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.267726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.268171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.268877 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.269626 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.270393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.402284 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:29.411174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2e74ab95-b708-4a4b-bb21-f7dff60c00ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.154536 Aug 18 17:13:29.411746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 88/177] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:29 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:30.279675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:30.280307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:30.286418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.287149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.287583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.288273 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.288721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.289122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:30.289508 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.289733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:30.297478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.298031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.298459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.299209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.299655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.300072 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.488439 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:30.492573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:30.497547 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-00e6f5b3-56ac-4761-96be-d9c4ca1f8166 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.221685 Aug 18 17:13:30.498367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 90/178] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:30 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:30.503342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:30.504671 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:30.512419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:30.512562 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.512998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.513433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.514124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.514569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.514706 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:30.515021 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.516099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9d924d0d-8d44-46f1-8559-30c65c16dd30 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.230908 Aug 18 17:13:30.516911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 89/179] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:30 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:30.650013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:30.657651 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fba8a068-b14d-495d-b93e-b23b3d9eff4d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.158134 Aug 18 17:13:30.658290 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 91/180] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:30 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:31.152640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-5662358e-349c-47dc-8a3a-1b97d6a07e12 req-70fbd64d-5793-4267-bc8e-64ddcb9569d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f96a52-4974-4053-bbf5-4719d7be5671", "name": "network-vif-plugged", "status": "completed", "tag": "2804c6c6-54ad-4beb-995c-9d13bb1213db"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:31.199686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-5662358e-349c-47dc-8a3a-1b97d6a07e12 req-70fbd64d-5793-4267-bc8e-64ddcb9569d8 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.199686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-5662358e-349c-47dc-8a3a-1b97d6a07e12 req-70fbd64d-5793-4267-bc8e-64ddcb9569d8 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.199686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-5662358e-349c-47dc-8a3a-1b97d6a07e12 req-70fbd64d-5793-4267-bc8e-64ddcb9569d8 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.199686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-5662358e-349c-47dc-8a3a-1b97d6a07e12 req-70fbd64d-5793-4267-bc8e-64ddcb9569d8 service nova] Creating event network-vif-plugged:2804c6c6-54ad-4beb-995c-9d13bb1213db for instance 41f96a52-4974-4053-bbf5-4719d7be5671 on hv-cinder-85367 Aug 18 17:13:31.199686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-5662358e-349c-47dc-8a3a-1b97d6a07e12 req-70fbd64d-5793-4267-bc8e-64ddcb9569d8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037528 Aug 18 17:13:31.200405 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 90/181] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:31.521533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:31.522453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:31.524796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=77 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:31.529388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.529867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.530297 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.531014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.531468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.531891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.544075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:31.544796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:31.551164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.551649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.552091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.552861 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.553601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.554037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.730151 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:31.740279 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9340a342-9b9a-4647-ab1d-7e71f507d1aa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.224036 Aug 18 17:13:31.741990 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 92/182] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:31 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:31.747361 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:31.758127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:31.760017 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:31.761102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3b8e2916-bda6-4378-9357-2a473f6e0371 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.222150 Aug 18 17:13:31.761557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:31.761705 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 91/183] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:31 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:31.774467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:31.781813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.782393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.782967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.794422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.794422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.794422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.919121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:31.926841 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ae904560-65c7-417d-a7d6-0a78c93a5473 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.170789 Aug 18 17:13:31.927461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 93/184] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:31 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:32.762566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:32.764679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:32.772774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:32.773305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:32.773785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:32.774513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:32.775002 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:32.775432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:32.785079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:32.787691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:32.792111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:32.792882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:32.793323 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:32.794278 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:32.794916 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:32.795622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:33.174754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:33.184223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-828ae9d3-89c7-4736-a91e-34226dfb7d0b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.425754 Aug 18 17:13:33.185063 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 92/185] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:32 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:33.189897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:33.190511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:33.197429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:33.198233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:33.198668 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:33.199450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:33.199906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:33.200335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:33.208602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:33.236049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:33.239647 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:33.241737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3ea1d226-1207-4668-9f3b-4e08dab83181 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.461269 Aug 18 17:13:33.242826 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 94/186] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:32 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:33.773632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:33.787055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5cac0572-a293-4281-ba7b-9fbbba220ae8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.599771 Aug 18 17:13:33.787055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 93/187] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:33 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:34.205416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:34.206025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:34.214096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:34.214582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:34.215054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:34.215853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:34.216302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:34.216723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:34.265010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:34.265663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:34.273021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:34.273546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:34.273979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:34.274683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:34.275223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:34.275646 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:34.297555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:34.422874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:34.433615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e803d6ac-7a28-4477-bd2b-3802461924fa tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.231503 Aug 18 17:13:34.434485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 95/188] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:34 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:34.468829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:34.480630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:34.482382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:34.483571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b84f9273-0e5e-464c-a2c0-1b7471acf9cf tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.222628 Aug 18 17:13:34.484356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 94/189] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:34 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:34.808033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:34.811202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:34.816083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:34.816744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:34.817401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:34.818421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:34.819096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:34.819763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:34.983306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:34.987419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:34.992991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-69c619db-5af6-4e76-8019-bd3429fd6f54 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.188592 Aug 18 17:13:34.992991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 96/190] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:34 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:35.455644 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:35.456252 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:35.462758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:35.463308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:35.463739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:35.464430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:35.464878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:35.465301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:35.508449 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:35.509075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:35.515943 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:35.516429 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:35.516865 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:35.517569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:35.518023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:35.518450 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:35.648197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:35.658340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-024eb530-2869-469e-aadd-216754c990b4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.206488 Aug 18 17:13:35.659545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 95/191] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:35 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:35.687534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:35.695801 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:35.697319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:35.698441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-82289f90-6b1a-4546-9274-09263c84c681 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.194754 Aug 18 17:13:35.699167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 97/192] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:35 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:36.015899 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:36.016513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:36.022604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:36.023122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:36.023556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:36.024239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:36.024689 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:36.025113 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:36.167973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:36.187322 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2d77b6ac-439a-4ddd-8c61-531529abe84f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.167220 Aug 18 17:13:36.187322 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 96/193] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:36 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:36.679921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:36.680635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:36.687159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:36.687632 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:36.688275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:36.689049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:36.689499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:36.689911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:36.720980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:36.721588 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:36.728012 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:36.728727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:36.729160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:36.729854 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:36.730298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:36.730718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:36.920116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:36.923299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:36.928109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3bd9689b-3cfe-449f-8250-ab0acb79a312 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.252023 Aug 18 17:13:36.928679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 98/194] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:36 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:36.934010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:36.935554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:36.936660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6293bc88-66e1-47d9-975f-72b15bc8928d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.219468 Aug 18 17:13:36.937386 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 97/195] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:36 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:37.202549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:37.203567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:37.209636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:37.210117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:37.210551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:37.211276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:37.212444 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:37.212871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:37.353176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:37.360862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b8a3e611-bf4b-4e1b-acd8-d3d683d8fa17 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.162148 Aug 18 17:13:37.364667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 99/196] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:37 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:37.950067 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:37.954708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:37.956838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:37.957308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:37.957734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:37.958419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:37.958865 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:37.959307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:37.959698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:37.960497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:37.966998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:37.967482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:37.967912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:37.968607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:37.969059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:37.969483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:38.165080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:38.175639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0d633c35-c1c6-40b9-8de5-3c230d57839c tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.229858 Aug 18 17:13:38.191564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 98/197] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:37 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:38.210013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:38.221950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:38.224051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:38.225158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b99189f4-0055-4c80-acb8-14066a44dc86 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.269273 Aug 18 17:13:38.226280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 100/198] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:37 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:38.382517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:38.383153 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:38.391028 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:38.391546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:38.392034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:38.392767 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:38.393225 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:38.393645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:38.535886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:38.545031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8ea2c9d9-a8f3-4ff0-bf63-d966b26efba5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.167526 Aug 18 17:13:38.545617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 99/199] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:38 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:39.202622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:39.203367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:39.209684 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:39.210161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:39.210738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:39.212138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:39.212902 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:39.213332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:39.249123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:39.249959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:39.256446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:39.257671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:39.258102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:39.259028 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:39.259622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:39.260177 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:39.458118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:39.467966 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5e4e0878-5ca9-4dab-a1cf-518588f1ff03 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.273207 Aug 18 17:13:39.468546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 101/200] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:39 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:39.501466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:39.512423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:39.514137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:39.516224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9a3324f5-be18-4337-82d1-d6a2902b417c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.270414 Aug 18 17:13:39.516224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 100/201] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:39 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:39.566419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:39.567494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:39.574499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:39.575011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:39.575543 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:39.576255 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:39.576926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:39.577363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:39.722526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:39.731188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-60220ee3-e4fc-40ff-aeeb-94b7bc5e973b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.169183 Aug 18 17:13:39.731761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 102/202] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:39 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:40.498652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:40.498652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:40.503397 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:40.504084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:40.504812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:40.505849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:40.506538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:40.507192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:40.537820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:40.538503 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:40.560059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:40.560059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:40.560385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:40.561614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:40.562070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:40.562665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:41.031484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:41.042073 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-36ac4355-d740-4e35-92e2-497ddb46862f tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.553460 Aug 18 17:13:41.042683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 101/203] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:40 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:41.047650 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-7ab14271-27ed-45ed-b10f-79c667b432f6 req-bb12409a-607b-4d1e-9f11-2b5c35b6610a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "name": "network-vif-plugged", "status": "completed", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:41.057555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-7ab14271-27ed-45ed-b10f-79c667b432f6 req-bb12409a-607b-4d1e-9f11-2b5c35b6610a service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:41.058032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-7ab14271-27ed-45ed-b10f-79c667b432f6 req-bb12409a-607b-4d1e-9f11-2b5c35b6610a service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:41.058463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-7ab14271-27ed-45ed-b10f-79c667b432f6 req-bb12409a-607b-4d1e-9f11-2b5c35b6610a service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:41.070156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-7ab14271-27ed-45ed-b10f-79c667b432f6 req-bb12409a-607b-4d1e-9f11-2b5c35b6610a service nova] Creating event network-vif-plugged:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:13:41.077191 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-7ab14271-27ed-45ed-b10f-79c667b432f6 req-bb12409a-607b-4d1e-9f11-2b5c35b6610a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032898 Aug 18 17:13:41.078197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 102/204] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:41.084811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:41.085521 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:41.093712 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:41.094830 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:41.095480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:41.096657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:41.097260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:41.097841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:41.233679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:41.247141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:41.248778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:41.250096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4e2f9513-f9fd-45cf-81f5-f9aaa567aca9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.716333 Aug 18 17:13:41.250654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 103/205] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:40 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:41.503128 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:41.511611 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6ed98291-9d21-461e-8628-94a0da99c351 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.432071 Aug 18 17:13:41.512192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 103/206] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:41 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:42.063890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:42.064485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:42.070519 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:42.071362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:42.071828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:42.079685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:42.079685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:42.079685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:42.224639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:42.237256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a83c0ff4-f867-45e5-a3d2-d86fbc63f7e3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.177131 Aug 18 17:13:42.247170 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 104/207] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:42 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:42.274677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:42.275316 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:42.282710 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:42.283230 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:42.283664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:42.284371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:42.284821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:42.286022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:42.427237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:42.437357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:42.439178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:42.440382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c16ed320-76d1-40b8-b7a0-151e479584aa tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.170372 Aug 18 17:13:42.441291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 104/208] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:42 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:42.532945 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:42.533474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:42.540069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:42.540556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:42.540980 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:42.541674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:42.542127 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:42.542624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:42.687242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:42.696526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-88d61ae3-7e1e-4756-95a0-7b067b93c147 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.167645 Aug 18 17:13:42.697861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 105/209] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:42 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:43.094328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-466be15f-1abc-4bc2-ab31-5dfd89a1f790 req-319d938e-b586-4aab-9638-2c0d280f4068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3608ff9-97d3-4e38-8212-c21692a8cbd3", "name": "network-vif-plugged", "status": "completed", "tag": "73e88f96-7c98-425d-8b5c-16175cefe3de"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:43.117324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-466be15f-1abc-4bc2-ab31-5dfd89a1f790 req-319d938e-b586-4aab-9638-2c0d280f4068 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.117324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-466be15f-1abc-4bc2-ab31-5dfd89a1f790 req-319d938e-b586-4aab-9638-2c0d280f4068 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.123328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-466be15f-1abc-4bc2-ab31-5dfd89a1f790 req-319d938e-b586-4aab-9638-2c0d280f4068 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.147024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-466be15f-1abc-4bc2-ab31-5dfd89a1f790 req-319d938e-b586-4aab-9638-2c0d280f4068 service nova] Creating event network-vif-plugged:73e88f96-7c98-425d-8b5c-16175cefe3de for instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 on hv-cinder-85367 Aug 18 17:13:43.156425 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-466be15f-1abc-4bc2-ab31-5dfd89a1f790 req-319d938e-b586-4aab-9638-2c0d280f4068 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066449 Aug 18 17:13:43.160298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 105/210] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:43.260287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.261022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:43.267221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.267876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.268445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.269317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.269649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.270066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.466617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.467829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:43.470342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:43.479240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7c7ac38f-a469-4d2d-92c6-0dcccaf2f5f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.223420 Aug 18 17:13:43.479849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 106/211] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:43.481409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.482410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.483542 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.485209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.486595 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.488300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.655102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:43.674046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:43.674046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:43.674046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-16877f6d-4297-4a09-9117-f6f35321f3c3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.209397 Aug 18 17:13:43.674275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 106/212] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:43.717911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.720137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:43.725437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.726118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.726621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.733994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:43.734536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:43.735022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:43.875014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:43.882998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cb298770-c7d4-4f52-b4ae-98b532950791 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1321 microversion: 2.1 time: 0.168981 Aug 18 17:13:43.884064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 107/213] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:44.501617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:44.502231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:44.509122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:44.509604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:44.510039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:44.510745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:44.511219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:44.511650 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:44.692920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:44.694410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:44.701972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:44.702935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:44.703448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:44.704536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:44.705181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:44.705862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:44.715763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:44.726180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6ce5012a-7624-4957-bfc8-5c96177afb7b tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.228285 Aug 18 17:13:44.727541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 107/214] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:44 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:44.890246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:44.898500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:44.900772 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:44.902701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-acef79d4-5d41-4438-b985-ed0af43fb6f6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1405 microversion: 2.20 time: 0.215970 Aug 18 17:13:44.903480 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 108/215] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:44 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:44.905914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:44.906520 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:44.916111 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:44.923695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:44.923695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:44.923695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:44.923695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:44.924057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.065020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:45.073015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d278ea31-d3bf-4f2b-b2c8-469887fecd1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1515 microversion: 2.1 time: 0.171887 Aug 18 17:13:45.073578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 108/216] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:44 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:45.096059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:45.099029 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:45.106201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.106310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.106829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.107606 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.108065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.108483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.174311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'flavor' on Instance uuid 41f96a52-4974-4053-bbf5-4719d7be5671 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:13:45.584780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-787ce100-60b2-4e94-890d-abe6a92d1b07 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671/action" status: 200 len: 32 microversion: 2.1 time: 0.493131 Aug 18 17:13:45.585829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 109/217] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:13:45 2022] POST /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671/action => generated 32 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:13:45.597505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:45.599101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:45.606563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.607311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.607994 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.609026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.609733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.610492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.750799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:45.752153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:45.760844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.761483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.762057 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.762954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.763541 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.764094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.795346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:45.804589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1f8aa6bc-ba59-4c07-85dc-f55659bcb145 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.211758 Aug 18 17:13:45.810430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 109/218] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:45 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:45.926331 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:45.926951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:45.935736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.936395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.937014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:45.937879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:45.938483 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:45.939086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:46.443687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:46.453470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f9b28c46-eb8c-4d22-a66a-f78079f613f4 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.707500 Aug 18 17:13:46.454582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 110/219] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:45 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:46.518938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:46.527989 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:46.529492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:46.530724 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1ae01f7c-34ef-4f1c-9183-ea41752ca26e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1597 microversion: 2.20 time: 0.608209 Aug 18 17:13:46.543142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 110/220] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:45 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1597 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:13:46.558060 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:46.558542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:46.565696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:46.566368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:46.566989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:46.567830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:46.568446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:46.568864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:46.588415 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:46.692951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8fea60de-0e13-4596-8f3b-a2e47941d1e1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.134469 Aug 18 17:13:46.692951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 111/221] 10.222.0.82 () {60 vars in 1316 bytes} [Thu Aug 18 17:13:46 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:13:46.832480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:46.833632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:46.853328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:46.853328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:46.853328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:46.857193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:46.857702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:46.860556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:47.284662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:47.303289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e092da83-b380-425a-b418-cd315b6a33b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.474892 Aug 18 17:13:47.308269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 111/222] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:46 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:47.475222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:47.475820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:47.483125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:47.485063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:47.485674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:47.486370 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:47.487033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:47.487640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:48.105975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:48.114345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-695ae47e-871e-4f0c-b183-fef19f367383 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1315 microversion: 2.1 time: 0.643160 Aug 18 17:13:48.114921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 112/223] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:47 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:48.329766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:48.331531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:48.337976 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:48.338525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:48.339178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:48.340043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:48.340638 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:48.341205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:48.380593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:48.694400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:48.703044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bb2aec7d-e87a-482f-aeeb-ef13f1faba96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.377302 Aug 18 17:13:48.703608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 112/224] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:48 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:48.999674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-faecd321-cbe5-4655-b3a6-213d20ca1798 req-b7d48113-2118-49b9-8dc7-ff10c5af72c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:49.010802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-faecd321-cbe5-4655-b3a6-213d20ca1798 req-b7d48113-2118-49b9-8dc7-ff10c5af72c9 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.011303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-faecd321-cbe5-4655-b3a6-213d20ca1798 req-b7d48113-2118-49b9-8dc7-ff10c5af72c9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.011732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-faecd321-cbe5-4655-b3a6-213d20ca1798 req-b7d48113-2118-49b9-8dc7-ff10c5af72c9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.023796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-faecd321-cbe5-4655-b3a6-213d20ca1798 req-b7d48113-2118-49b9-8dc7-ff10c5af72c9 service nova] Creating event network-changed:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:13:49.029781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-faecd321-cbe5-4655-b3a6-213d20ca1798 req-b7d48113-2118-49b9-8dc7-ff10c5af72c9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033745 Aug 18 17:13:49.030944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 113/225] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:49.141444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:49.142383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:49.157121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.159864 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.160680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.161582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.164510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.165965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.360573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:49.369090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4445cf69-b591-480d-9853-f78ed70f6495 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1502 microversion: 2.1 time: 0.232181 Aug 18 17:13:49.369664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 113/226] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:49 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:49.725509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:49.728210 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:49.737603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.738094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.738530 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.744737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.744737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.744737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.906562 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:49.916173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-19621683-882f-4482-8ce2-98f4127447a6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.193884 Aug 18 17:13:49.920615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 114/227] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:49 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:50.937939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:50.938557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:50.945635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:50.946120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:50.946562 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:50.947286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:50.947744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:50.948171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:51.079774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:51.088167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4410dd96-26db-4636-a68c-bbd3bc09b43f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.154114 Aug 18 17:13:51.088719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 114/228] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:50 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:52.108905 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:52.109582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:52.116535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:52.121306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:52.121306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:52.121306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:52.121306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:52.121772 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:52.249247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:52.257320 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a950b795-fea5-465e-9f00-c15a06e41001 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.152212 Aug 18 17:13:52.257934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 115/229] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:52 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:53.279128 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:53.296318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:53.296318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:53.296318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:53.296318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:53.296665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:53.296665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:53.296665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:53.418124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:53.425826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-572e8c06-fa95-4c17-bcd6-a93148a6be8e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.150761 Aug 18 17:13:53.426380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 115/230] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:53 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:54.447910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:54.448526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:54.455074 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:54.455793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:54.456434 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:54.457200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:54.457695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:54.458091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:54.597171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:54.606150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5f770afb-7300-41bf-8481-a959b320e116 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.163274 Aug 18 17:13:54.606722 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 116/231] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:54 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:55.629947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:55.630561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:55.637073 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:55.637554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:55.637986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:55.638709 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:55.639157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:55.639584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:55.777697 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:55.785919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b8a8e7b7-7310-4533-b5da-00fc9549678b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.161614 Aug 18 17:13:55.786613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 116/232] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:55 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:56.535266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e46b3062-2b1c-4c80-8e32-a1934dde671f"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:56.537478 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:56.543806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:56.544284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:56.544713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:56.545446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:56.545891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:56.546309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:56.807551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:56.808217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:56.810080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=66 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:56.814673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:56.815189 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:56.817373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:56.817373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:56.817373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:56.817373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:56.964711 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:56.972296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-334a74fa-a6b0-4827-8820-32a712025ce9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.169157 Aug 18 17:13:56.972942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 117/233] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:56 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:57.994050 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:57.994712 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:58.000504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:58.000984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:58.001418 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:58.002106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:58.002557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:58.003018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:58.130388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:58.138743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cee8f7a6-1561-4db2-8264-a16ef6af81ee tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.149068 Aug 18 17:13:58.139653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 118/234] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:57 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:59.159612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:59.160242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:59.166030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:59.166505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:59.167282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:59.167961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:59.168405 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:59.168821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:59.300580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:59.308332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5f5555a2-ef5b-4378-880d-c957cfdbef8f tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.152449 Aug 18 17:13:59.308907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 119/235] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:59 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:00.329493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:00.330098 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:00.336845 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:00.337345 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:00.337777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:00.338657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:00.339161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:00.339570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:00.471325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:00.479623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e9bb2b64-e553-4c82-aa62-46672e34c535 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.153960 Aug 18 17:14:00.480186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 120/236] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:00 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:01.391760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-859e9c27-fb3c-4c09-9379-2fbccf0610ab tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "POST /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.860432 Aug 18 17:14:01.392430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 117/237] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:13:56 2022] POST /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3/os-volume_attachments => generated 194 bytes in 4862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:01.499292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:01.499901 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:01.505897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:01.506318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:01.510987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:01.510987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:01.510987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:01.510987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:01.643570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:01.651947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-82d20ac6-71af-4988-aa07-e579d08382b8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.156430 Aug 18 17:14:01.652508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 121/238] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:01 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:02.674860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:02.675489 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:02.677457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=52 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:02.682834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:02.683353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:02.683822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:02.684627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:02.684972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:02.685402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:02.820363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:02.834150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4276e3ce-8357-494f-bdc2-c79259817b2b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.164043 Aug 18 17:14:02.834987 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 118/239] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:02 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:03.854246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:03.854854 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:03.861181 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:03.861763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:03.862267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:03.863029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:03.863488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:03.863914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:04.022974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:04.030871 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4b764642-6b6b-4258-ae83-a2352d623b3e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.180424 Aug 18 17:14:04.031461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 122/240] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:03 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:05.051899 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:05.052510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:05.059066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:05.059545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:05.059982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:05.060670 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:05.061155 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:05.061574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:05.193238 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:05.202027 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c1d1b77c-0675-41fb-8c4e-d778967c3a1e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.153988 Aug 18 17:14:05.205643 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 119/241] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:05 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:06.223942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:06.224547 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:06.231142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:06.231623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:06.232056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:06.232744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:06.233195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:06.233621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:06.365232 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:06.373221 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-31e47d58-9ec6-4987-b187-d4294412e533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.153224 Aug 18 17:14:06.373779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 123/242] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:06 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:07.394686 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:07.395339 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:07.401744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:07.402220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:07.403488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:07.403488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:07.403874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:07.404297 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:07.568425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:07.576446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c04b6417-53b5-497e-a8c2-0ce16b20aa48 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.185542 Aug 18 17:14:07.585899 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 120/243] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:07 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:08.600692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:08.601351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:08.607774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:08.608231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:08.608710 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:08.609395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:08.609835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:08.610251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:08.745976 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:08.753744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-15ba182f-aab3-408a-b87b-76706329cc4e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.159628 Aug 18 17:14:08.754303 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 124/244] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:08 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:09.775826 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:09.776441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:09.784672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:09.785168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:09.787869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:09.788855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:09.789438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:09.790076 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:09.969794 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:09.982140 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-681adcf6-af73-4f5d-aa75-94882e3a0aac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.210886 Aug 18 17:14:09.997312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 121/245] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:09 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:11.003610 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:11.004229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:11.010825 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:11.011333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:11.011764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:11.012454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:11.012901 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:11.013324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:11.167555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:11.175437 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1b884446-f72c-40fb-b05c-65d36c2a5a37 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.175572 Aug 18 17:14:11.175998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 125/246] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:10 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:12.201835 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:12.201835 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:12.208409 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:12.208886 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:12.209676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:12.216537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:12.217257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:12.217697 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:12.369011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:12.376620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fcb4f36c-bf0b-4a79-b600-89bf8ff499eb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.180210 Aug 18 17:14:12.377222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 122/247] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:12 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:13.401737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:13.402507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:13.408661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:13.409143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:13.409577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:13.410279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:13.410728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:13.411307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:13.560245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:13.568706 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-496537e8-c7e9-4ad5-bc8c-9b149e251a96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.171999 Aug 18 17:14:13.583312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 126/248] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:13 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:14.590666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:14.591247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:14.597896 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:14.599645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:14.599645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:14.599645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:14.600063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:14.600492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:14.747713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:14.755581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d5742348-eab5-40fa-b4cc-827b91e7464b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.168669 Aug 18 17:14:14.756144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 123/249] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:14 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:15.776478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:15.777103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:15.783215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:15.783702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:15.784131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:15.784826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:15.785509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:15.786126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:15.958139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:15.962419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-516ec643-70b1-4697-949b-d6d941ea466d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.190549 Aug 18 17:14:15.963020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 127/250] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:15 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:16.984181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:16.987595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:16.994759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:16.995272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:16.995710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:16.996418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:16.996875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:16.997450 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:17.151628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:17.162169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fe06e72e-6828-41fb-aa18-2e5d020b6c2a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.180979 Aug 18 17:14:17.162169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 124/251] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:16 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:18.181872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:18.182478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:18.188883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:18.189363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:18.189792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:18.190480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:18.190943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:18.191530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:18.325124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:18.332719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ba0be844-3287-405c-aa30-4e1b5bdabf03 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.154779 Aug 18 17:14:18.333282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 128/252] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:18 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:19.354344 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:19.354972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:19.361337 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:19.361807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:19.362243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:19.362937 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:19.363622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:19.364002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:19.503207 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:19.511072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e4b271b3-0ec6-449e-b95a-7eec9d7a69f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.161157 Aug 18 17:14:19.511785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 125/253] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:19 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:19.703039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:19.703526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:19.714066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:19.715266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:19.716461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:19.717535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:19.718478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:19.719816 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:19.730394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=99 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:19.765770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Going to try to terminate instance {{(pid=121216) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:14:20.177262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6d9de21f-0c53-4a22-a216-b01e8555c4e5 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 204 len: 0 microversion: 2.1 time: 0.477654 Aug 18 17:14:20.177855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 129/254] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:14:19 2022] DELETE /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:14:20.190187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:20.190811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:20.201361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:20.201944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:20.202854 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:20.204144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:20.204649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:20.206282 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:20.228211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:20.367135 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:20.376551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-233bc04f-f935-4341-b450-3aae27fa2304 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1554 microversion: 2.1 time: 0.190350 Aug 18 17:14:20.377243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 126/255] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:20 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:20.533974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:20.534884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:20.541855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:20.542354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:20.542881 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:20.543887 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:20.544356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:20.545000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:20.686673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:20.696026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c3d53869-392a-4645-8ec7-2c7daf8507db tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.166277 Aug 18 17:14:20.696672 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 130/256] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:20 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:21.400263 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:21.401011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:21.411481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:21.412068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:21.423597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:21.423597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:21.423597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:21.423597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:21.578553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:21.595671 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f572b5f2-628d-413c-b57c-9cef3af81def tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1554 microversion: 2.1 time: 0.194994 Aug 18 17:14:21.596284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 127/257] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:21 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:21.716355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:21.717043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:21.722924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:21.723440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:21.723874 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:21.724564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:21.725072 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:21.725444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:21.870797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:21.879912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-29866433-a298-4cff-a03d-308c5c93b935 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.166561 Aug 18 17:14:21.895876 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 131/258] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:21 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:22.617394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:22.617997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:22.625134 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:22.625779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:22.626147 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:22.626817 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:22.627289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:22.627789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:22.771043 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:22.785740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3bda53ab-f015-480c-bd25-37a45423b194 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1554 microversion: 2.1 time: 0.172598 Aug 18 17:14:22.786307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 128/259] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:22 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:22.900852 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:22.901496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:22.907653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:22.908136 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:22.908572 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:22.909263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:22.909717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:22.910141 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:23.222630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:23.231458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ada329f8-ffa0-4426-bd98-16e17795edc7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.335415 Aug 18 17:14:23.232325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 132/260] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:22 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:23.670182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-c83a7399-3fb8-4090-bd8c-2815bf0a3faa req-5cb6790e-39c6-4b1a-b223-79e169e9fe16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3608ff9-97d3-4e38-8212-c21692a8cbd3", "name": "network-vif-deleted", "tag": "73e88f96-7c98-425d-8b5c-16175cefe3de"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:23.681535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c83a7399-3fb8-4090-bd8c-2815bf0a3faa req-5cb6790e-39c6-4b1a-b223-79e169e9fe16 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:23.682048 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c83a7399-3fb8-4090-bd8c-2815bf0a3faa req-5cb6790e-39c6-4b1a-b223-79e169e9fe16 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:23.682516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c83a7399-3fb8-4090-bd8c-2815bf0a3faa req-5cb6790e-39c6-4b1a-b223-79e169e9fe16 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:23.696688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-c83a7399-3fb8-4090-bd8c-2815bf0a3faa req-5cb6790e-39c6-4b1a-b223-79e169e9fe16 service nova] Creating event network-vif-deleted:73e88f96-7c98-425d-8b5c-16175cefe3de for instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 on hv-cinder-85367 Aug 18 17:14:23.699681 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-c83a7399-3fb8-4090-bd8c-2815bf0a3faa req-5cb6790e-39c6-4b1a-b223-79e169e9fe16 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033234 Aug 18 17:14:23.700287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 129/261] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:23.808904 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:23.808904 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:23.814562 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:23.815077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:23.815513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:23.816196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:23.816647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:23.817206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:23.904054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:23.912788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3ade0c22-b596-46f6-bf2a-c9c3b10d81d3 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1512 microversion: 2.1 time: 0.108938 Aug 18 17:14:23.913853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 133/262] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:23 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1512 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:24.253273 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:24.254477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:24.263670 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:24.264677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:24.265154 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:24.265878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:24.266335 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:24.266768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:24.401193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:24.409492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1b716af9-3cfd-4adf-a773-b783aad2cfdd tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.160986 Aug 18 17:14:24.410378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 130/263] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:24 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:24.933748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:24.934486 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:24.940507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:24.941056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:24.941556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:24.942313 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:24.942836 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:24.943350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:24.978280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:24.978753 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:24.979214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:24.979672 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lazy-loading 'fault' on Instance uuid d3608ff9-97d3-4e38-8212-c21692a8cbd3 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:14:25.032835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72104f038d24821be824a45e108d1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c908d398424970b13440ee7f6048d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:25.047742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6b4f7edd-b649-4f28-b4d5-bf86c270a8e2 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 200 len: 1351 microversion: 2.1 time: 0.117944 Aug 18 17:14:25.049433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 134/264] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:24 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:25.109571 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-820183037", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "networks": [{"uuid": "2247d476-be30-4ae3-9bb0-4447dfb13e99"}]}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:25.164429 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] validate_networks() for [('2247d476-be30-4ae3-9bb0-4447dfb13e99', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:14:25.431071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:25.431786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:25.437908 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:25.438494 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:25.439165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:25.439873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:25.440326 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:25.440788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:25.573704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:14:25.574129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:14:25.574614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:14:25.575086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:14:25.575504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:14:25.593585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:25.594072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:25.594616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:25.595590 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:25.596044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:25.596468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:25.609848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:25.613832 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Getting quotas for project 9e161860d18f4d608a9ce4177cce7b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:14:25.618157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6c212ec8-6d3c-4907-9195-2929a4529f86 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.191163 Aug 18 17:14:25.630963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 135/265] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:25 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:25.631133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Getting quotas for user 497f5cef83ff4fe69e00e3ccf703088d and project 9e161860d18f4d608a9ce4177cce7b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:14:25.631133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:14:25.633895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:14:25.790892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1ff08935-5afb-4ad0-993b-4b0a144acd1d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685689 Aug 18 17:14:25.791571 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 131/266] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:14:25.802456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-280d98ec-3f9c-4fef-8bb3-e6342439c732 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:25.803291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-280d98ec-3f9c-4fef-8bb3-e6342439c732 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:25.862640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-280d98ec-3f9c-4fef-8bb3-e6342439c732 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:25.870422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-280d98ec-3f9c-4fef-8bb3-e6342439c732 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1213 microversion: 2.1 time: 0.071655 Aug 18 17:14:25.872659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 136/267] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:25 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:26.069106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:26.070054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:26.076982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:26.077486 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:26.077916 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:26.078603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:26.079082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:26.079620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:26.093614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] HTTP exception thrown: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Request method failure captured: Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 HTTP/1.1 Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nL_zaCSuKXVj_EN-4X2hcFhgQ8IUVVFLuFDLlQLzHgjy4kTWFdqNbr70ETR50JmrppmfPx4jhb2CmD7UIL4M0onpbgh37zj7yMLYyGyCBz2DLB9crroxrhvwcplhkCMVJCYQlRvlqdSZssuCjHjXIuU9EDj7V_3idkTsWKFa0Vn1OI Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:14:26.098221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/66c908d398424970b13440ee7f6048d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: e72104f038d24821be824a45e108d1ac Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.099692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'd3608ff9-97d3-4e38-8212-c21692a8cbd3'} Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:14:26.101094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.102687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.104078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Returning 404 to user: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:14:26.104078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-28e1af42-2eb7-4fc5-9ef2-3413196b98b9 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 404 len: 111 microversion: 2.1 time: 0.034503 Aug 18 17:14:26.104078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 132/268] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:26 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:26.217624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:26.219970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:26.227192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:26.227681 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:26.228110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:26.228960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:26.229409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:26.229826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:26.247740 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] HTTP exception thrown: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Request method failure captured: Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3/os-volume_attachments HTTP/1.1 Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nL_zaCSuKXVj_EN-4X2hcFhgQ8IUVVFLuFDLlQLzHgjy4kTWFdqNbr70ETR50JmrppmfPx4jhb2CmD7UIL4M0onpbgh37zj7yMLYyGyCBz2DLB9crroxrhvwcplhkCMVJCYQlRvlqdSZssuCjHjXIuU9EDj7V_3idkTsWKFa0Vn1OI Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:14:26.252642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/66c908d398424970b13440ee7f6048d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: e72104f038d24821be824a45e108d1ac Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.254168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'server_id': 'd3608ff9-97d3-4e38-8212-c21692a8cbd3'} Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:14:26.258315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:26.259629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:26.260860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Returning 404 to user: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:14:26.260860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1b33ebab-de3b-4a18-a193-fc93f1e1c8de tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040410 Aug 18 17:14:26.260860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 137/269] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:14:26 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:26.640346 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:26.641607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:26.649155 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:26.652133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:26.652133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:26.652133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:26.652133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:26.652533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:26.791529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:26.803432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a5a1fbdd-18a8-4480-8065-7c57e92766d6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.165388 Aug 18 17:14:26.803432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 133/270] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:26 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:26.900033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c5448edd-ea92-4007-b0ff-d25ad5ec8f3c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:26.900641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c5448edd-ea92-4007-b0ff-d25ad5ec8f3c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:26.902620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:26.955614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c5448edd-ea92-4007-b0ff-d25ad5ec8f3c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:26.964266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c5448edd-ea92-4007-b0ff-d25ad5ec8f3c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1213 microversion: 2.1 time: 0.068674 Aug 18 17:14:26.964853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 138/271] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:26 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:27.700878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:27.701605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:27.708023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.708506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.708943 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.711310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.711310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.711310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.723811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] HTTP exception thrown: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Request method failure captured: Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 HTTP/1.1 Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nL_zaCSuKXVj_EN-4X2hcFhgQ8IUVVFLuFDLlQLzHgjy4kTWFdqNbr70ETR50JmrppmfPx4jhb2CmD7UIL4M0onpbgh37zj7yMLYyGyCBz2DLB9crroxrhvwcplhkCMVJCYQlRvlqdSZssuCjHjXIuU9EDj7V_3idkTsWKFa0Vn1OI Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:14:27.725861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/66c908d398424970b13440ee7f6048d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: e72104f038d24821be824a45e108d1ac Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.727117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'd3608ff9-97d3-4e38-8212-c21692a8cbd3'} Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:14:27.727784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.728789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.729825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Returning 404 to user: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:14:27.729825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4e48ac1c-9678-4493-89ad-d5eb664c9044 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 404 len: 111 microversion: 2.1 time: 0.030307 Aug 18 17:14:27.729825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 134/272] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:14:27 2022] DELETE /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:27.736510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:27.737643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] [instance: d3608ff9-97d3-4e38-8212-c21692a8cbd3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:27.744882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.745446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.745952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.746720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.747262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.747683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.761336 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] HTTP exception thrown: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Request method failure captured: Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 HTTP/1.1 Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nL_zaCSuKXVj_EN-4X2hcFhgQ8IUVVFLuFDLlQLzHgjy4kTWFdqNbr70ETR50JmrppmfPx4jhb2CmD7UIL4M0onpbgh37zj7yMLYyGyCBz2DLB9crroxrhvwcplhkCMVJCYQlRvlqdSZssuCjHjXIuU9EDj7V_3idkTsWKFa0Vn1OI Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:14:27.763833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/66c908d398424970b13440ee7f6048d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/66c908d398424970b13440ee7f6048d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 66c908d398424970b13440ee7f6048d6 Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628616608 Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: e72104f038d24821be824a45e108d1ac Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-DeleteServersTestJSON-1628616608-project Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.770449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'd3608ff9-97d3-4e38-8212-c21692a8cbd3'} Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:14:27.772628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. Aug 18 17:14:27.774038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:14:27.775217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] Returning 404 to user: Instance d3608ff9-97d3-4e38-8212-c21692a8cbd3 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:14:27.775217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-38e9e8ab-f61e-4a73-b9b3-c6d798f5eba7 tempest-DeleteServersTestJSON-1628616608 tempest-DeleteServersTestJSON-1628616608-project] 10.222.0.82 "GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3" status: 404 len: 111 microversion: 2.1 time: 0.033263 Aug 18 17:14:27.775217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 139/273] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:27 2022] GET /compute/v2.1/servers/d3608ff9-97d3-4e38-8212-c21692a8cbd3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:27.824049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:27.824966 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:27.839282 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.839972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.840672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.841630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.842435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.843109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.987662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:27.988371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:27.996043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.996619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.997132 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:27.997906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:27.998433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:27.999364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:28.017068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:28.030764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-36608c31-069b-498c-86c6-b5f9b7c5b67c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.210545 Aug 18 17:14:28.031746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 135/274] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:27 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:28.087367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:28.095681 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8e44ee5d-488c-43f3-a5bd-9e2c84d84029 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1265 microversion: 2.1 time: 0.113510 Aug 18 17:14:28.109602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 140/275] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:27 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:29.055532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:29.056115 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:29.068239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:29.068239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:29.068239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:29.068239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:29.069082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:29.069082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:29.118686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:29.119539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:29.127403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:29.127975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:29.128415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:29.131353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:29.132171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:29.132623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:29.258768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:29.266682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a4e38cae-af0d-48f9-88ee-2f74f0903c62 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1265 microversion: 2.1 time: 0.152605 Aug 18 17:14:29.267223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 141/276] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:29 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:29.288993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:29.296885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c7b67de0-b99a-4a3b-be94-620f2f771257 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.247990 Aug 18 17:14:29.297453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 136/277] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:29 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:30.287451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:30.288195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:30.294401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:30.294882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:30.295347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:30.296039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:30.296497 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:30.296922 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:30.318930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:30.321560 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:30.329397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:30.330120 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:30.330738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:30.331637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:30.332261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:30.332840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:30.412687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:30.422283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3455ea39-0414-42a7-b472-7c6345be31ed tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1265 microversion: 2.1 time: 0.138683 Aug 18 17:14:30.422928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 142/278] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:30 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:30.668657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:30.676644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-df12abd9-ef37-4463-9abf-1047433ab5a8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.361557 Aug 18 17:14:30.677221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 137/279] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:30 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:31.445614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:31.447578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:31.453682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:31.454983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:31.455577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:31.456468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:31.457183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:31.457744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:31.529555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:31.537556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-992e054f-7ed6-42eb-b8af-541d06471fd5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1265 microversion: 2.1 time: 0.096913 Aug 18 17:14:31.551302 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 143/280] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:31 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:31.698238 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:31.699038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:31.705628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:31.706176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:31.706702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:31.707497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:31.708028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:31.708524 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:31.866559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:31.875521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-32c41a3e-a385-42e3-9184-0e6541809d99 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.181681 Aug 18 17:14:31.876102 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 138/281] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:31 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:32.557529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:32.558160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:32.564112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:32.564590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:32.565020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:32.565705 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:32.566241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:32.566616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:32.627772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:32.635337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fce469c1-5a38-4e36-8894-6ed24bff4749 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1265 microversion: 2.1 time: 0.081593 Aug 18 17:14:32.635910 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 144/282] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:32 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:32.897889 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:32.898937 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:32.901634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:32.906380 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:32.906995 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:32.907507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:32.908288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:32.908784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:32.909264 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:33.052174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:33.060595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7213b479-c9cd-422b-afc8-f262769d4f74 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.167189 Aug 18 17:14:33.061168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 139/283] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:32 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:33.656250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:33.656834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:33.664857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:33.665335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:33.669857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:33.669857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:33.669857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:33.669857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:33.731724 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:33.739478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-65d7b20d-8be4-44f1-b11c-e6ee4e3c0231 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1265 microversion: 2.1 time: 0.087249 Aug 18 17:14:33.740029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 145/284] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:33 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:34.081940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:34.082813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:34.090357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:34.091100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:34.091469 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:34.092166 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:34.092616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:34.093063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:34.313844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:34.329222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2f29d3a5-625d-429f-b093-4cd00f324013 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.251032 Aug 18 17:14:34.329963 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 140/285] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:34 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:34.330142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1548717437", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "networks": [{"uuid": "4f606d5a-76c2-4d8b-b2b9-13fdf0a57fc9"}]}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:34.388845 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] validate_networks() for [('4f606d5a-76c2-4d8b-b2b9-13fdf0a57fc9', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:14:34.763153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:34.763782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:34.777391 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:34.777949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:34.778397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:34.779589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:34.780360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:34.780795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:35.082221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:35.092257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-12a3254d-643c-427e-875c-e75dcaa1856a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1283 microversion: 2.1 time: 0.333511 Aug 18 17:14:35.092776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 141/286] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:34 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1283 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:35.138685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:14:35.139237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:14:35.139593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:14:35.144137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:14:35.144137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:14:35.155506 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:35.156041 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:35.156455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:35.157176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:35.157624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:35.158042 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:35.181356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Getting quotas for project 420292ae9c0547cc9755f24c23d419c3. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:14:35.186238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Getting quotas for user 32f58f87972d46be9496e6216f1f5ca1 and project 420292ae9c0547cc9755f24c23d419c3. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:14:35.198575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:14:35.201161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:14:35.338485 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-80f02a18-daba-4faf-bdf8-281881f6cf3c tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013186 Aug 18 17:14:35.339400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 146/287] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:14:35.350116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:35.350390 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3ae91132-6283-4b74-ab9e-a1cc7f0caa34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:35.350835 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:35.351576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3ae91132-6283-4b74-ab9e-a1cc7f0caa34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:35.362578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:35.362578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:35.362578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:35.362578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:35.362850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:35.367322 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:35.425111 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3ae91132-6283-4b74-ab9e-a1cc7f0caa34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:35.440332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3ae91132-6283-4b74-ab9e-a1cc7f0caa34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1219 microversion: 2.1 time: 0.093833 Aug 18 17:14:35.443730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 147/288] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:35 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:35.596486 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:35.603116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:35.605746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-35aaffb2-7741-44d0-926a-653862e9ac81 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1521 microversion: 2.1 time: 0.259946 Aug 18 17:14:35.606320 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 142/289] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:35 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:36.117036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:36.117694 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:36.124556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:36.125068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:36.125462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:36.126428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:36.126917 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:36.127350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:36.368780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:36.371245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:36.377921 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d96f1d87-1cb5-461d-80a8-ff39a253a5cf tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.266471 Aug 18 17:14:36.378597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 148/290] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:36 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:36.462563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-442e4362-8739-4ede-b5b9-6c64a9c0853e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:36.463432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-442e4362-8739-4ede-b5b9-6c64a9c0853e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:36.465171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:36.527173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-442e4362-8739-4ede-b5b9-6c64a9c0853e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:36.534662 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-442e4362-8739-4ede-b5b9-6c64a9c0853e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1219 microversion: 2.1 time: 0.076531 Aug 18 17:14:36.535283 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 143/291] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:36 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:36.627217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:36.627863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:36.634074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:36.634550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:36.635013 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:36.635713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:36.636167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:36.636585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:36.845340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:36.856773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b05620b3-4c2b-4ffe-af1e-8b6e43d73e43 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1501 microversion: 2.1 time: 0.233092 Aug 18 17:14:36.857590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 149/292] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:36 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1501 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:36.884923 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:36.885870 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:36.892779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:36.894002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:36.894997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:36.896012 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:36.897164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:36.897915 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.007690 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-530d930c-003e-451d-835c-c7104434b8f4 req-1f11b697-751a-46da-87ae-a6311d89b91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c84c4ef-4393-4671-a825-5d09a5e1427a", "tag": "314a4c2d-0f0b-4652-be47-223cdbc51e7d"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:37.018338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-530d930c-003e-451d-835c-c7104434b8f4 req-1f11b697-751a-46da-87ae-a6311d89b91a service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.018821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-530d930c-003e-451d-835c-c7104434b8f4 req-1f11b697-751a-46da-87ae-a6311d89b91a service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.019291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-530d930c-003e-451d-835c-c7104434b8f4 req-1f11b697-751a-46da-87ae-a6311d89b91a service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.035508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-530d930c-003e-451d-835c-c7104434b8f4 req-1f11b697-751a-46da-87ae-a6311d89b91a service nova] Creating event network-changed:314a4c2d-0f0b-4652-be47-223cdbc51e7d for instance 4c84c4ef-4393-4671-a825-5d09a5e1427a on hv-cinder-85367 Aug 18 17:14:37.044593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-530d930c-003e-451d-835c-c7104434b8f4 req-1f11b697-751a-46da-87ae-a6311d89b91a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038530 Aug 18 17:14:37.044593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 150/293] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:14:37.096727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:37.106856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2b89377f-a917-4233-98c5-ed0b51f94ad9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1516 microversion: 2.1 time: 0.231407 Aug 18 17:14:37.107547 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 144/294] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:36 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:37.407495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:37.408822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:37.418607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.419180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.419608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.420295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.420741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.421155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.556250 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:37.556749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:37.557443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:37.564330 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.564488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6a9c2f5c-a4a6-4d86-870a-9bd72bac1881 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.165517 Aug 18 17:14:37.564743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.564976 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 151/295] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:37 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:37.565563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.569938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.572950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.575067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.638708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:37.646313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-88e7db32-7734-40f4-a075-831c359b3dc5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1223 microversion: 2.1 time: 0.093951 Aug 18 17:14:37.646957 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 145/296] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:37 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:38.586476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:38.587112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:38.593005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:38.593491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:38.600866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:38.600866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:38.600866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:38.600866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:38.667815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:38.668428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:38.675173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:38.675667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:38.676107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:38.676812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:38.677265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:38.677993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:38.692626 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:38.746084 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:38.753550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1ffbaa1f-5596-47c5-bca8-3c6a00874761 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1223 microversion: 2.1 time: 0.089766 Aug 18 17:14:38.757088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 146/297] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:38 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:38.764455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:38.773670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-57620a82-8294-40b9-bcc5-6aaba306c92b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.192002 Aug 18 17:14:38.774239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 152/298] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:38 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:39.775727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:39.776343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:39.792066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:39.792066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:39.792066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:39.792066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:39.792676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:39.792676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:39.794444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:39.795177 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:39.802005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:39.804441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:39.805095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:39.806859 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:39.807504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:39.808562 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:39.916175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:39.926101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0fbe1abb-e86b-4c39-8ff1-b1131b1dcfc0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1215 microversion: 2.1 time: 0.154283 Aug 18 17:14:39.926962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 147/299] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:39 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:40.194001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:40.201815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cdc9168f-1c75-430d-80ef-0802cb5a34c2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.411357 Aug 18 17:14:40.202374 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 153/300] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:39 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:40.948421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:40.949111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:40.955760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:40.956364 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:40.956856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:40.957615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:40.958133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:40.958618 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:41.232593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:41.232593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:41.241531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:41.242126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:41.242781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:41.243735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:41.247242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:41.247953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:41.263481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:41.275834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9a34558a-1f73-4c79-af01-a653a2413982 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1279 microversion: 2.1 time: 0.331242 Aug 18 17:14:41.276794 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 148/301] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:40 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:41.429027 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:41.436646 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3458a6cd-5948-4357-abdf-85df8eac64d7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.217611 Aug 18 17:14:41.437218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 154/302] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:41 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:42.298408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:42.299038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:42.306961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.307447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.307928 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.308625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.309065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.309483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.457701 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:42.458238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:42.464486 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.464966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.465399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.466094 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.466540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.466999 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.655774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:42.664173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:42.664797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-94a4b10f-8b54-44ad-b623-3b5f8e1cb280 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.369962 Aug 18 17:14:42.665367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 149/303] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:42 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:42.671761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2a42502a-9cb0-4775-9960-7ec43918b2c0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.218103 Aug 18 17:14:42.672302 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 155/304] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:42 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:43.342691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:43.345024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:43.352123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.361743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.361743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.361743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.361743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.362130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.378701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'flavor' on Instance uuid 1e590ac9-d3f2-4279-aba4-d75780182977 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:14:43.685690 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:43.690279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:43.696473 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.697765 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.698374 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.699276 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.699751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.700359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.743831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1b62feb8-7db0-41b0-9aec-d38d2fbebfd8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/action" status: 200 len: 32 microversion: 2.1 time: 0.405324 Aug 18 17:14:43.744948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 150/305] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:14:43 2022] POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/action => generated 32 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:14:43.752425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:43.753251 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:43.760442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.761159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.768601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.769647 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.771486 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.771931 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.898652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:43.907659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-db8bb926-4237-457b-8b67-bb64f6ae356f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.225750 Aug 18 17:14:43.908551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 156/306] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:43 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:43.914269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:43.914866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:43.920976 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.921455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.921884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.922564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.923202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.923774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.951612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:43.963880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b8b1e702-89bb-46f2-a581-b3223ce13c5a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.217577 Aug 18 17:14:43.964917 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 151/307] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:43 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:44.059839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:44.068770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bc9ad13a-119d-4c9e-962e-0d9eed4f5da4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.158272 Aug 18 17:14:44.069408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 157/308] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:43 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:44.929893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:44.930522 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:44.937065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:44.940189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:44.940189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:44.940189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:44.940189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:44.940567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:44.986198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:44.987713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:44.994828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:44.995471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:44.997553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:44.997553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:44.997553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:44.997848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:45.135488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:45.143786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7e990104-b629-4dd1-9d7a-38d76072ac6f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.218066 Aug 18 17:14:45.144347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 152/309] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:44 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:45.158767 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:45.159600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:45.166260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:45.166818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:45.167187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:45.167895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:45.168322 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:45.168820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:45.170659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:45.178999 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:45.186872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d23b4405-c2e4-4876-8629-d8ad41934e81 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.205142 Aug 18 17:14:45.199052 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 158/310] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:44 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:45.320062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:45.328364 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3ba08b9e-b759-497b-8c08-9ad989e35ace tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.182981 Aug 18 17:14:45.330512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 153/311] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:45 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:46.168607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:46.169851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:46.171101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=12 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:46.176505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.177578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.178436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.179484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.179935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.180349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.215040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:46.216604 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:46.232299 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.233229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.234171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.235620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.239815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.240344 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.668853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:46.678882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d62b1871-50ce-44c8-88ea-9f979ec676b9 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.515760 Aug 18 17:14:46.680780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 159/312] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:46 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:46.686338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:46.687087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:46.693963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.697360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.697360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.697360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.697360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.697730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.797701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:46.806219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b29e837d-3ab0-41fa-a456-f80ba5c89fa3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.598037 Aug 18 17:14:46.807059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 154/313] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:46 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:46.820644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-e8d1e160-6cba-4a08-89ce-37f1cadec60b req-00bc5361-a4ab-4d49-8c66-b6fcbc4a22b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82112920-df63-40b7-a941-0d5cc01d5fe3", "tag": "66eb0809-6d6b-4fe8-bd51-a7ba888689fe"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:46.830435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e8d1e160-6cba-4a08-89ce-37f1cadec60b req-00bc5361-a4ab-4d49-8c66-b6fcbc4a22b9 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:46.830957 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e8d1e160-6cba-4a08-89ce-37f1cadec60b req-00bc5361-a4ab-4d49-8c66-b6fcbc4a22b9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:46.831578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e8d1e160-6cba-4a08-89ce-37f1cadec60b req-00bc5361-a4ab-4d49-8c66-b6fcbc4a22b9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:46.843906 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-e8d1e160-6cba-4a08-89ce-37f1cadec60b req-00bc5361-a4ab-4d49-8c66-b6fcbc4a22b9 service nova] Creating event network-changed:66eb0809-6d6b-4fe8-bd51-a7ba888689fe for instance 82112920-df63-40b7-a941-0d5cc01d5fe3 on hv-cinder-85367 Aug 18 17:14:46.858819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-e8d1e160-6cba-4a08-89ce-37f1cadec60b req-00bc5361-a4ab-4d49-8c66-b6fcbc4a22b9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045244 Aug 18 17:14:46.859507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 155/314] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:47.093737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:47.102295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6ef4e63d-bfe2-4cda-8d09-4dfa53d13f96 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.419590 Aug 18 17:14:47.102866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 160/315] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:46 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:47.680308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-0af0808f-fa84-4e92-b674-df1302092e58 req-1e7253d1-ebf3-445e-979c-60d2a6a7b977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c4ef-4393-4671-a825-5d09a5e1427a", "name": "network-vif-plugged", "status": "completed", "tag": "314a4c2d-0f0b-4652-be47-223cdbc51e7d"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:47.686797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:47.693655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0af0808f-fa84-4e92-b674-df1302092e58 req-1e7253d1-ebf3-445e-979c-60d2a6a7b977 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:47.694137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0af0808f-fa84-4e92-b674-df1302092e58 req-1e7253d1-ebf3-445e-979c-60d2a6a7b977 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:47.698843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0af0808f-fa84-4e92-b674-df1302092e58 req-1e7253d1-ebf3-445e-979c-60d2a6a7b977 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:47.704779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:47.705907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:47.708562 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-0af0808f-fa84-4e92-b674-df1302092e58 req-1e7253d1-ebf3-445e-979c-60d2a6a7b977 service nova] Creating event network-vif-plugged:314a4c2d-0f0b-4652-be47-223cdbc51e7d for instance 4c84c4ef-4393-4671-a825-5d09a5e1427a on hv-cinder-85367 Aug 18 17:14:47.712729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:47.713215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:47.713682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:47.714373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:47.715004 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:47.715472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-0af0808f-fa84-4e92-b674-df1302092e58 req-1e7253d1-ebf3-445e-979c-60d2a6a7b977 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040641 Aug 18 17:14:47.715738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:47.718961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 156/316] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:47.828483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:47.829398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:47.836810 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:47.837293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:47.837720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:47.838421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:47.838932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:47.839348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:47.873597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:47.882131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9e0b0c69-a14c-4793-a71e-22a840467fba tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.181763 Aug 18 17:14:47.883106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 161/317] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:47 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:47.975219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:47.982492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0d08dbdc-19ea-465b-96d3-36cff3028ad6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.158940 Aug 18 17:14:47.983122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 157/318] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:47 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:48.123728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:48.124368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:48.134615 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:48.135207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:48.135645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:48.136349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:48.136801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:48.137263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:48.266800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:48.277685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5cd9f222-6177-42b4-90ac-57f7525a97a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.157640 Aug 18 17:14:48.278259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 162/319] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:48 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:48.902876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:48.903527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:48.910017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:48.910460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:48.910885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:48.912142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:48.912595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:48.913046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:49.012493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:49.015619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:49.028873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:49.029722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:49.030185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:49.030961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:49.031423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:49.031850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:49.059847 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:49.068338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-70ad1303-c033-4067-9f10-fbb641a3dc93 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.169547 Aug 18 17:14:49.068904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 158/320] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:48 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:49.171260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:49.180431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-de77f8c5-280c-4516-82fd-335f9028fe5f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.177692 Aug 18 17:14:49.181081 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 163/321] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:48 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:49.299789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:49.300425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:49.306827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:49.307349 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:49.307790 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:49.308488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:49.308947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:49.309373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:49.453795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:49.462944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-87dbe982-ce20-40ed-a938-9782665bc64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.167207 Aug 18 17:14:49.463516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 159/322] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:49 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:50.089795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:50.090410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:50.096369 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:50.097324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:50.097911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:50.099207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:50.099826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:50.100398 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:50.201739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:50.202353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:50.210421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:50.210935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:50.211359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:50.212066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:50.212596 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:50.213030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:50.241554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:50.251102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d1c96352-44cd-4a9f-80a2-ca6c4444a1bc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.164992 Aug 18 17:14:50.265006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 164/323] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:50 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:50.376259 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:50.384773 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9208fb5b-0612-4145-b22e-0aa91131651f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.186734 Aug 18 17:14:50.385410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 160/324] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:50 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:50.484255 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:50.484783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:50.490794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:50.491344 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:50.491778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:50.492505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:50.492987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:50.493410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:50.627325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:50.636703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0a09fc29-13dc-4c96-9d29-3cd98de37a42 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.156351 Aug 18 17:14:50.637463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 165/325] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:50 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:51.272760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:51.280630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:51.280630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:51.280630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:51.281393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:51.281578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:51.282222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:51.282653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:51.406566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:51.407228 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:51.414422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:51.415139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:51.415964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:51.416660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:51.417646 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:51.422546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:51.423000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:51.429439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:51.433183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-caf17b24-40e3-499d-92bf-7f837b86d78d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.164270 Aug 18 17:14:51.434299 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 161/326] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:51 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:51.576409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:51.585112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ba5986cd-abec-456e-892a-57ca7a58751c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.183282 Aug 18 17:14:51.599431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 166/327] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:51 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:51.659202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:51.659722 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:51.666433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:51.666939 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:51.667365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:51.668065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:51.668518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:51.668935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:51.686725 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:51.812170 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:51.821527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7a3bb295-0e44-4c80-afac-2953a7de6250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.167079 Aug 18 17:14:51.822321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 162/328] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:51 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:52.454219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:52.454862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:52.460938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:52.461355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:52.461786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:52.462471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:52.462940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:52.463366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:52.599833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:52.605796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:52.606488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:52.608324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f0b986d1-0576-407c-a820-7e95e1c027cb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.158079 Aug 18 17:14:52.608801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 167/329] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:52 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:52.613909 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:52.614393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:52.614829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:52.615550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:52.615998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:52.616422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:52.743244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:52.750764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-51294a74-2889-4ccd-9514-866412b180a1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.148880 Aug 18 17:14:52.751353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 163/330] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:52 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:52.843014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:52.843622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:52.850429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:52.850922 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:52.851360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:52.852136 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:52.852643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:52.853082 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:52.979215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:52.986778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-77e6241d-c92f-4bd8-b710-40d7a18c2d8c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.147780 Aug 18 17:14:52.987385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 168/331] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:52 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:53.629050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:53.630412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:53.636833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:53.637317 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:53.637755 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:53.638447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:53.638916 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:53.639343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:53.770728 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:53.772418 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:53.773112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:53.779443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:53.779928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:53.780367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:53.780841 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e40a15d2-38fd-48ea-a126-de39ff6f3344 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.155422 Aug 18 17:14:53.781132 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:53.781425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 164/332] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:53 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:53.781983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:53.782571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:53.911414 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:53.919180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5164b683-774e-4d36-a66a-c2a388fe5431 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.151039 Aug 18 17:14:53.919749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 169/333] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:53 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:54.008274 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:54.008882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:54.014850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.015371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.015802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.016490 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.016942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.017367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.148037 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:54.155600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cb1a6b2e-831a-4609-96b6-20d5bfa28586 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.151827 Aug 18 17:14:54.156166 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 165/334] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:54 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:54.802393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:54.803024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:54.809528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.810211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.810812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.811991 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.812601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.813020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.940131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:54.940744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:54.948026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.948518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.948994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.949700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.950154 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.950579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:55.054106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:55.061213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b7e50ad7-ba12-4474-907e-d0c8fd2d3c28 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.262897 Aug 18 17:14:55.061789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 170/335] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:54 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:55.176431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:55.176981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:55.183088 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:55.183567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:55.183998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:55.184693 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:55.185158 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:55.185562 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:55.566972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:55.574855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d1bf8837-1f8a-406c-91d6-2d3b0e3f53db tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.638625 Aug 18 17:14:55.575437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 166/336] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:54 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:55.642235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:55.650211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a39f9f4b-2c80-4e7a-a31b-46c86439690c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.478012 Aug 18 17:14:55.650786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 171/337] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:55 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:56.082928 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:56.083574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:56.089898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.090382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.090814 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.091530 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.091988 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.092414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.228785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:56.236520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ebd3e6e2-abde-4ccc-b5cb-dc18703371a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.157701 Aug 18 17:14:56.237086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 167/338] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:56 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:56.596805 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:56.597421 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:56.604173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.604655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.606069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.606069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.606286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.606718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.671521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:56.672132 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:56.678326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.678846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.679311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.680019 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.680455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.680921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.755162 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:56.766078 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6db8c1a1-a346-4240-98ee-6197130daf0c tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1313 microversion: 2.1 time: 0.171569 Aug 18 17:14:56.766078 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 172/339] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:56 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:56.869656 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:56.878003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a1069672-2cbd-4f7f-9628-ad983c7174ea tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.210515 Aug 18 17:14:56.879561 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 168/340] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:56 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:57.026778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-86b6326b-a3f5-4541-9eef-bc27542da279 req-6124363f-1aca-47e7-8198-1e3ee9420c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82112920-df63-40b7-a941-0d5cc01d5fe3", "name": "network-vif-plugged", "status": "completed", "tag": "66eb0809-6d6b-4fe8-bd51-a7ba888689fe"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:57.036105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-86b6326b-a3f5-4541-9eef-bc27542da279 req-6124363f-1aca-47e7-8198-1e3ee9420c96 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.036596 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-86b6326b-a3f5-4541-9eef-bc27542da279 req-6124363f-1aca-47e7-8198-1e3ee9420c96 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.037018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-86b6326b-a3f5-4541-9eef-bc27542da279 req-6124363f-1aca-47e7-8198-1e3ee9420c96 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.048889 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-86b6326b-a3f5-4541-9eef-bc27542da279 req-6124363f-1aca-47e7-8198-1e3ee9420c96 service nova] Creating event network-vif-plugged:66eb0809-6d6b-4fe8-bd51-a7ba888689fe for instance 82112920-df63-40b7-a941-0d5cc01d5fe3 on hv-cinder-85367 Aug 18 17:14:57.054086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-86b6326b-a3f5-4541-9eef-bc27542da279 req-6124363f-1aca-47e7-8198-1e3ee9420c96 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 Aug 18 17:14:57.054681 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 173/341] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:57.257624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:57.258160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:57.264033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.264531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.264967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.265641 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.266083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.266501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.407215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:57.416434 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2e38728c-5d1c-4406-91e9-62dd0f06bb11 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.163368 Aug 18 17:14:57.417221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 169/342] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:57 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:57.795324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:57.796029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:57.803696 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.804152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.804569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.805265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.805708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.806123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.900863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:57.901481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:57.907704 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.908172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.908612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.915425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.915897 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.916331 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:58.023058 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:58.038200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7ab53310-c48e-4213-8185-7c06e9669998 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1496 microversion: 2.1 time: 0.246606 Aug 18 17:14:58.038828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 174/343] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:57 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1496 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:58.083356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:58.091504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-66f5eb08-547d-4bc9-b355-d90e00b8c909 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.194644 Aug 18 17:14:58.092554 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 170/344] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:57 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:58.437565 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:58.438176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:58.440392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:58.445849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.446328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.446761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:58.447477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.447928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.448349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:58.586788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:58.595547 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5877d091-282a-4c31-ac39-1dcb4e34326d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.161869 Aug 18 17:14:58.596115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 175/345] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:58 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:58.980727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:58.981360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:58.987740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.988224 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.989445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:58.990158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.990595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.991077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.017187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:14:59.114246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:59.114977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:59.120821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:59.121296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:59.121727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.122404 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:59.122851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:59.123470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.253009 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:59.260016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b2ca0d4e-49b2-4653-bf44-ae9e49bea8f3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.150603 Aug 18 17:14:59.260572 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 176/346] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:59 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:59.540723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a7bb8fab-760c-41fe-9479-b094b3319316 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 204 len: 0 microversion: 2.1 time: 0.563527 Aug 18 17:14:59.541305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 171/347] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:14:58 2022] DELETE /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:14:59.549348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:59.552921 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:59.556363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:59.556932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:59.557457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.558256 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:59.558798 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:59.559305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.617607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:59.618293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:59.624532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:59.625005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:59.625709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.626408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:59.626853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:59.627292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.737652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:59.748974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0734cb26-0004-4837-a152-b8ad7376aec4 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1502 microversion: 2.1 time: 0.203194 Aug 18 17:14:59.759153 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 177/348] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:59 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:59.790628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:59.798498 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c1065cea-b8bc-4ab1-9da9-1dc6560b20a5 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.185498 Aug 18 17:14:59.799180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 172/349] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:59 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:00.280908 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:00.281531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:00.288376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.288847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.289272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.289952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.290393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.290810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.432609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:00.440227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c0938204-30a8-4f65-b2fa-2c2cd92d9af2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.163471 Aug 18 17:15:00.443439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 178/350] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:00 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:00.772259 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:00.772977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:00.779437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.780230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.781201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.782072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.782670 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.783599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.820924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:00.823405 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:00.829252 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.829748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.830187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.830933 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.839927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.840381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.978600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:00.986604 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3b1d9a3d-09e4-435d-b16e-32e2a24e63e2 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1502 microversion: 2.1 time: 0.219248 Aug 18 17:15:00.990489 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 173/351] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:00 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:01.012575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:01.017579 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-54f88e72-f71b-4d03-a510-15d784814316 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.201346 Aug 18 17:15:01.018135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 179/352] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:00 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:01.461626 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:01.462293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:01.468359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:01.468906 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:01.469366 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:01.470067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:01.470525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:01.470971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:01.608574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:01.616307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-16ef5898-85ac-4ba6-81e9-fcbfc0737ae2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.158801 Aug 18 17:15:01.620329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 174/353] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:01 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:02.009041 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:02.009624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:02.015780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.016310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.016749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.017476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.017927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.018350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.040745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:02.042784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:02.048195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.048675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.049105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.049840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.050290 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.050711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.228175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:02.235641 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:02.236751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ff658389-4068-44dc-90e6-ed3738101f8d tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1502 microversion: 2.1 time: 0.232373 Aug 18 17:15:02.237321 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 180/354] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:02 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:02.241629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-83ded8dc-ac7b-4454-8798-299cfb5ac914 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1319 microversion: 2.1 time: 0.204736 Aug 18 17:15:02.242703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 175/355] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:02 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:02.639391 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:02.640314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:02.648066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.648774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.649474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.650430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.650994 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.656470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.930505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:02.938751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2c01bcd2-100f-4a7a-ae2c-c089cd0cdee0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.303186 Aug 18 17:15:02.939343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 181/356] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:02 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:03.259868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:03.260497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:03.261626 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:03.262242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:03.263947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:03.267400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.267874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.268302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.268843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.268993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.269441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.269578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.269893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.270286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.271662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.272137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.275310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.565633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:03.573475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:03.575157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fc9e3d95-7919-4c79-bfa0-cbe2a2e4139f tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1502 microversion: 2.1 time: 0.319439 Aug 18 17:15:03.584665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 176/357] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:03 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:03.584665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-365008bc-bf5b-4b67-baa5-91f9bc054d6a req-0733c95b-9415-4bc3-a234-ba95fce05613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c84c4ef-4393-4671-a825-5d09a5e1427a", "name": "network-vif-deleted", "tag": "314a4c2d-0f0b-4652-be47-223cdbc51e7d"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:03.591504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-696dfc6d-9157-424a-8a62-c94324070d37 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1507 microversion: 2.1 time: 0.333346 Aug 18 17:15:03.592656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 182/358] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:03 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:03.600244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-365008bc-bf5b-4b67-baa5-91f9bc054d6a req-0733c95b-9415-4bc3-a234-ba95fce05613 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.600834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-365008bc-bf5b-4b67-baa5-91f9bc054d6a req-0733c95b-9415-4bc3-a234-ba95fce05613 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.601283 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-365008bc-bf5b-4b67-baa5-91f9bc054d6a req-0733c95b-9415-4bc3-a234-ba95fce05613 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.624740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-365008bc-bf5b-4b67-baa5-91f9bc054d6a req-0733c95b-9415-4bc3-a234-ba95fce05613 service nova] Creating event network-vif-deleted:314a4c2d-0f0b-4652-be47-223cdbc51e7d for instance 4c84c4ef-4393-4671-a825-5d09a5e1427a on hv-cinder-85367 Aug 18 17:15:03.630578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-365008bc-bf5b-4b67-baa5-91f9bc054d6a req-0733c95b-9415-4bc3-a234-ba95fce05613 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052978 Aug 18 17:15:03.631477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 177/359] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:03.962049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:03.962572 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:03.968474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.968978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.969415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.970332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.970782 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.971230 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.987016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:04.107866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:04.115337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-39c97ae2-0dcb-4aab-b9c8-686db6190e93 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.157981 Aug 18 17:15:04.115897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 183/360] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:03 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:04.600385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:04.606406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:04.609357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:04.609898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:04.610336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:04.611058 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:04.611696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:04.612268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:04.616613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:04.657715 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:04.658296 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:04.658725 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:04.659948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lazy-loading 'fault' on Instance uuid 4c84c4ef-4393-4671-a825-5d09a5e1427a {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:15:04.705174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:04.713871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2c735f91-717e-4658-879e-0024d78c25f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 200 len: 1303 microversion: 2.1 time: 0.120574 Aug 18 17:15:04.718620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 178/361] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:04 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:05.136506 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:05.145932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:05.145932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.145932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.145932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.147255 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.147896 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.148473 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.351760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:05.359698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e1b182e5-3c6c-4729-804a-0b6307cc3f89 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1502 microversion: 2.1 time: 0.227604 Aug 18 17:15:05.360265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 184/362] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:05 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:05.380524 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9cd6268-ea1d-4c34-8cb5-c63385041bc2"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:05.382850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:05.389955 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.390744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.391246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.391959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.392523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.392953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.419711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] HTTP exception thrown: Cannot 'attach_volume' instance 1e590ac9-d3f2-4279-aba4-d75780182977 while it is in vm_state rescued Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Request method failure captured: Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/os-volume_attachments HTTP/1.1 Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 74 Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nMBn6eQh4g6Ef-NDef2IXjmOxcIYI3WcPprGjEubTNTP544Ce_YGDSQbTI-KX9h5KLLurAQ8LYiP0SZ5Fu7D_E3bKe78ANfioYKnRjWXFwcupQvS9ZQDVOYsDpFa5rCMzANCP2fMFZJEw6Zkt0qjHTElMZ1rhcr8QJt9L7iLkwE8Ck Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:15:05.421402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/289886000851431da2e3aebc3b47be8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: ecdea0572cc64ca394cd4d977f536d5a Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {"volumeAttachment": {"volumeId": "a9cd6268-ea1d-4c34-8cb5-c63385041bc2"}} Aug 18 17:15:05.422746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Cannot 'attach_volume' instance 1e590ac9-d3f2-4279-aba4-d75780182977 while it is in vm_state rescued Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'server_id': '1e590ac9-d3f2-4279-aba4-d75780182977', 'body': {'volumeAttachment': {'volumeId': 'a9cd6268-ea1d-4c34-8cb5-c63385041bc2'}}} Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:15:05.423581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1e590ac9-d3f2-4279-aba4-d75780182977 while it is in vm_state rescued Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:05.424724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1e590ac9-d3f2-4279-aba4-d75780182977 while it is in vm_state rescued Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Returning 409 to user: Cannot 'attach_volume' instance 1e590ac9-d3f2-4279-aba4-d75780182977 while it is in vm_state rescued {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-94ea403c-b87b-430e-b8cf-1b4d900e32b1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046401 Aug 18 17:15:05.425806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 179/363] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:15:05 2022] POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 17:15:05.433949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:05.438092 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:05.444526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.445014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.445457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.446163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.446618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.447109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.686740 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d813fb4e-1562-4ce5-a413-f4349526808a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/action" status: 202 len: 0 microversion: 2.1 time: 0.256822 Aug 18 17:15:05.687414 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 185/364] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:15:05 2022] POST /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:15:05.698341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:05.699711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:05.709227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.714032 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.714032 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.714032 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.714032 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.714375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.738264 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:05.742849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 4c84c4ef-4393-4671-a825-5d09a5e1427a] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:05.756222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.756868 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.757348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.758084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:05.758549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:05.759025 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.784289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] HTTP exception thrown: Instance 4c84c4ef-4393-4671-a825-5d09a5e1427a could not be found. Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Request method failure captured: Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a HTTP/1.1 Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nNtjTcLlUFMYNxLPbYtdj5je-15af1QV4LpKe7NvJdwQv3QwxV3OVLxaxWj_xcK3zh-TDPOHbkFOh_ApfEEewVIcVt1zph4IetMwq3VhsojMBRiPmgbgFpn_gKvG9fLoJrbQLbAZ-lYTZ_rlrHGktmr7QmtY-8mMki1_nkNZGrUsVY Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 9e161860d18f4d608a9ce4177cce7b6f Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesActionsTest-353265711 Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:15:05.789444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesActionsTest-353265711 Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 9e161860d18f4d608a9ce4177cce7b6f Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesActionsTest-353265711 Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesActionsTest-353265711-project Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 497f5cef83ff4fe69e00e3ccf703088d Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesActionsTest-353265711-project Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 4c84c4ef-4393-4671-a825-5d09a5e1427a could not be found. Aug 18 17:15:05.790755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '4c84c4ef-4393-4671-a825-5d09a5e1427a'} Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c84c4ef-4393-4671-a825-5d09a5e1427a could not be found. Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:15:05.792947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c84c4ef-4393-4671-a825-5d09a5e1427a could not be found. Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c84c4ef-4393-4671-a825-5d09a5e1427a could not be found. Aug 18 17:15:05.794156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:05.798949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Returning 404 to user: Instance 4c84c4ef-4393-4671-a825-5d09a5e1427a could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:15:05.798949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-92613c63-710a-4050-b91f-39ad58788daa tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a" status: 404 len: 111 microversion: 2.1 time: 0.058452 Aug 18 17:15:05.798949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 186/365] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:05 2022] GET /compute/v2.1/servers/4c84c4ef-4393-4671-a825-5d09a5e1427a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:15:05.928237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-395393995", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "networks": [{"uuid": "2247d476-be30-4ae3-9bb0-4447dfb13e99"}]}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:06.030295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] validate_networks() for [('2247d476-be30-4ae3-9bb0-4447dfb13e99', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:15:06.047731 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:06.057408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-70aef0b5-e3d0-46de-9c40-be12b5475bde tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1510 microversion: 2.1 time: 0.365025 Aug 18 17:15:06.058053 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 180/366] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:05 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:06.687323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:15:06.688978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:15:06.689987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:15:06.690657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:15:06.691676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:15:06.709417 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:06.712178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:06.712178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:06.712178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:06.712178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:06.712570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:06.732372 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Getting quotas for project 9e161860d18f4d608a9ce4177cce7b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:06.736541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Getting quotas for user 497f5cef83ff4fe69e00e3ccf703088d and project 9e161860d18f4d608a9ce4177cce7b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:06.750367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:15:06.753238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:15:06.919929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f4e0fca2-ab3d-430d-8568-3b1ed9f9f635 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996778 Aug 18 17:15:06.920718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 187/367] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:15:06.932477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-785242c0-2329-4b39-9d71-3eda2e0ae4f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:06.933674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-785242c0-2329-4b39-9d71-3eda2e0ae4f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:07.012887 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-785242c0-2329-4b39-9d71-3eda2e0ae4f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:07.026123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-785242c0-2329-4b39-9d71-3eda2e0ae4f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1213 microversion: 2.1 time: 0.097584 Aug 18 17:15:07.028690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 181/368] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:06 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:07.085171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:07.085171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:07.102678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:07.103208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:07.103703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:07.104347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:07.104797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:07.105222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:07.424884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:07.459487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0e254b61-b76a-45ee-a40a-df260075ab8b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1510 microversion: 2.1 time: 0.383576 Aug 18 17:15:07.471616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 188/369] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:07 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:08.050616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ddeb06be-0764-474e-aaf9-ca4b1a32902b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:08.051372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ddeb06be-0764-474e-aaf9-ca4b1a32902b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:08.127983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ddeb06be-0764-474e-aaf9-ca4b1a32902b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:08.136225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ddeb06be-0764-474e-aaf9-ca4b1a32902b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1213 microversion: 2.1 time: 0.089893 Aug 18 17:15:08.145422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 182/370] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:08 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:08.481923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:08.482601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:08.488980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:08.489829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:08.490573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:08.491518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:08.491957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:08.492539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:08.700567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:08.710673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-990d7ed7-2c33-4543-96ed-1c3687b3e729 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1510 microversion: 2.1 time: 0.233392 Aug 18 17:15:08.711640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 189/371] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:08 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:09.160814 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:09.163094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:09.169755 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:09.171428 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:09.171950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:09.173277 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:09.173952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:09.174579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:09.290969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:09.300669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dcbed580-65d9-4d76-8536-7148dbcbbf79 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1217 microversion: 2.1 time: 0.143752 Aug 18 17:15:09.311563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 183/372] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:09 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:09.733091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:09.733927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:09.752657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:09.753142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:09.753577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:09.754283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:09.756593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:09.757569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:09.992483 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:10.002720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b609fc2f-c086-439d-8802-f9d62e61bae7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1516 microversion: 2.1 time: 0.273988 Aug 18 17:15:10.015983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 190/373] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:09 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:10.324892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:10.325660 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:10.333185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:10.333962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:10.334497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:10.335371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:10.336054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:10.336687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:10.429361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:10.437333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6b0d65c2-59bb-4559-aa30-b2a475d269e5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1265 microversion: 2.1 time: 0.118150 Aug 18 17:15:10.438009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 184/374] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:10 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:11.462304 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:11.463867 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:11.475330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.478571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.480076 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.481041 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.481501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.481922 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.556136 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:11.564330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-62a7ab83-6438-4c8e-a221-b5da1c15862a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1271 microversion: 2.1 time: 0.106815 Aug 18 17:15:11.576261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 191/375] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:11 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:12.606199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:12.609149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:12.626483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:12.627184 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:12.627645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:12.628711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:12.635345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:12.635920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:12.762263 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:12.778420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0b6fa2e3-5d0d-4f3f-873a-c6dae861bbb9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1271 microversion: 2.1 time: 0.189635 Aug 18 17:15:12.778420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 185/376] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:12 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:13.165954 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-edfe8db8-91b6-41aa-a231-d37c918c6568 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'create', calling method: .version_select at 0x7fd1f2e71d30>, body: {"keypair": {"name": "tempest-keypair-2011686297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKwdMRzjFlSeliOVFVPAW2Hrn3poyuV9RobUF8Izxqwimb5+In5p977XcRKed3JO5vfEqpMzSfo57RwZGGYm90T2EC7gVdP2ec1+awlBIEOmbcOKMJKYCB780m0yaByiQ=="}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:13.186511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-edfe8db8-91b6-41aa-a231-d37c918c6568 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for project 289886000851431da2e3aebc3b47be8a. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:13.192181 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-edfe8db8-91b6-41aa-a231-d37c918c6568 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for user ecdea0572cc64ca394cd4d977f536d5a and project 289886000851431da2e3aebc3b47be8a. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:13.315479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-edfe8db8-91b6-41aa-a231-d37c918c6568 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154613 Aug 18 17:15:13.317950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 192/377] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:15:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:13.808802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:13.810343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:13.821742 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:13.822224 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:13.822656 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:13.823401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:13.827600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:13.827600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:14.166222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:14.185743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-46c16192-25e2-4906-afee-1e3dd6c770f7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.387718 Aug 18 17:15:14.186334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 186/378] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:13 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:14.373445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-b408ab77-813d-402a-8975-a482fdbaf8cc req-6360d6ac-cea6-4556-a26c-5109bd568d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c4db630-6d52-4c0a-b0d8-a333d29a985f", "tag": "f48a6257-e15d-44f2-bdf5-33de18937e1f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:14.388851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-b408ab77-813d-402a-8975-a482fdbaf8cc req-6360d6ac-cea6-4556-a26c-5109bd568d93 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:14.389524 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-b408ab77-813d-402a-8975-a482fdbaf8cc req-6360d6ac-cea6-4556-a26c-5109bd568d93 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:14.396130 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-b408ab77-813d-402a-8975-a482fdbaf8cc req-6360d6ac-cea6-4556-a26c-5109bd568d93 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:14.404104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-b408ab77-813d-402a-8975-a482fdbaf8cc req-6360d6ac-cea6-4556-a26c-5109bd568d93 service nova] Creating event network-changed:f48a6257-e15d-44f2-bdf5-33de18937e1f for instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f on hv-cinder-85367 Aug 18 17:15:14.410485 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-b408ab77-813d-402a-8975-a482fdbaf8cc req-6360d6ac-cea6-4556-a26c-5109bd568d93 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040725 Aug 18 17:15:14.412513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 193/379] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:15.209469 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:15.211154 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:15.221157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:15.221932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:15.222885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:15.224041 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:15.224795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:15.225427 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:15.522409 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:15.531139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8a0ba53e-00ef-4634-bdfe-da53015f3898 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.327572 Aug 18 17:15:15.548473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 187/380] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:15 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:16.560883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:16.564197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:16.596032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:16.596673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:16.598877 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:16.600847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:16.601517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:16.602106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:16.723228 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:16.900735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:16.909127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7cfc1e0a-0e56-496e-b9a2-00f9684788df tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.358199 Aug 18 17:15:16.918954 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 194/381] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:16 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:17.445537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2124691074", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e02a190-793a-4b39-97b9-468a8b8e735b"}], "security_groups": [{"name": "tempest-securitygroup--2048514407"}], "key_name": "tempest-keypair-2011686297", "user_data": "}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:17.593786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] validate_networks() for [('9e02a190-793a-4b39-97b9-468a8b8e735b', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:15:17.933774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:17.935997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:17.953902 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:17.954296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:17.956392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:17.960191 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:17.960929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:17.969679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:18.137176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=4 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:18.639280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:18.648008 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c3e3b47c-7735-4b2a-b5d3-2fef914f1bad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.718538 Aug 18 17:15:18.649065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 195/382] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:17 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:18.698326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:15:18.699118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:15:18.699708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:15:18.700219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:15:18.700733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:15:18.710666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:18.711853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:18.712365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:18.713371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:18.713781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:18.714551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:18.756987 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for project 289886000851431da2e3aebc3b47be8a. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:18.761771 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Getting quotas for user ecdea0572cc64ca394cd4d977f536d5a and project 289886000851431da2e3aebc3b47be8a. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:18.776686 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:15:18.779045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:15:18.927430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9257b7d9-866d-4f67-8e1b-8dfdd385bba7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.487854 Aug 18 17:15:18.928404 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 188/383] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:15:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:15:18.940563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d405a8fc-686c-405b-8a56-75b8e9b0eef5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:18.942031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d405a8fc-686c-405b-8a56-75b8e9b0eef5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:19.032027 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d405a8fc-686c-405b-8a56-75b8e9b0eef5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:19.045038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d405a8fc-686c-405b-8a56-75b8e9b0eef5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1246 microversion: 2.1 time: 0.109401 Aug 18 17:15:19.046200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 196/384] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:18 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:19.670472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:19.671112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:19.677381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:19.677866 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:19.678309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:19.679037 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:19.679494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:19.679920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:19.851420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:19.891014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b994ca46-1b3e-4e10-bf24-83b9493f06ad tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.225127 Aug 18 17:15:19.895863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 189/385] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:19 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:20.068730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:20.070085 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:20.077296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.077815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.078269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.079164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.079810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.080396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.147286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:20.156131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6f9b92d5-8214-4b41-8430-0f29a252ddc9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1250 microversion: 2.1 time: 0.093651 Aug 18 17:15:20.156971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 197/386] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:20 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:20.920947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:20.922359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:20.930973 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.933739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.934190 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.934949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.935400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.935991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.148175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:21.164293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-081e56c9-b943-4c7f-8466-1c5ec4a3588b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.247246 Aug 18 17:15:21.165026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 190/387] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:20 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:21.179122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:21.180441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:21.187292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:21.187899 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:21.189234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.190126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:21.190635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:21.191500 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.307911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:21.319165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-557cbd87-ca7e-4449-978d-41fe069fd8f2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1298 microversion: 2.1 time: 0.145223 Aug 18 17:15:21.320148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 198/388] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:21 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:21.486449 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c6368036-af44-4ae4-90e7-e2baf7c9228e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Action: 'create', calling method: .version_select at 0x7fd1f36c8670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2080356117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpSP8rWjxnIPWIJ0IgzkYIjjvh7Pchpb+9MeWCMZqTjCXJo4rAfgQdIXvnDxp0AlGfB4ujHMT6KWQGMqq10JVBl3oKBMqfUdwdPbn1jl97uCbFMLBgXLfa2hLpRfAGrHw=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:21.511760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-c6368036-af44-4ae4-90e7-e2baf7c9228e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Getting quotas for project f8802bed1f6b4be991ff011f40bf8622. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:21.517562 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-c6368036-af44-4ae4-90e7-e2baf7c9228e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Getting quotas for user ebc5df40911b4186abec99c01e0702a6 and project f8802bed1f6b4be991ff011f40bf8622. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:21.641232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c6368036-af44-4ae4-90e7-e2baf7c9228e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.416039 Aug 18 17:15:21.642211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 191/389] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:15:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:22.190245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:22.191695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:22.203307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.204026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.205459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.208239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.212072 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.212720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.346386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:22.347644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:22.357416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.357912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.358357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.359247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.359682 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.360112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.652836 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:22.661941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:22.679099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bc3b808b-1a3d-416b-ac5d-9153223cb9a0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.477896 Aug 18 17:15:22.679099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 199/390] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:22 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:22.679332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7f1bdf20-471d-440b-8be1-6fd4488bf799 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.329018 Aug 18 17:15:22.679332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 192/391] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:22 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:23.498447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-7cbab533-7eec-4f55-9e0f-2cab4467a3be req-5f57fd08-9e31-4842-9e89-d2818f0118ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d082780b-e2a5-480f-9edf-5793b00ce795", "tag": "384961f9-0f01-4d12-864e-a14aa382c228"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:23.508387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-7cbab533-7eec-4f55-9e0f-2cab4467a3be req-5f57fd08-9e31-4842-9e89-d2818f0118ea service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.509157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-7cbab533-7eec-4f55-9e0f-2cab4467a3be req-5f57fd08-9e31-4842-9e89-d2818f0118ea service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.509585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-7cbab533-7eec-4f55-9e0f-2cab4467a3be req-5f57fd08-9e31-4842-9e89-d2818f0118ea service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.520988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-7cbab533-7eec-4f55-9e0f-2cab4467a3be req-5f57fd08-9e31-4842-9e89-d2818f0118ea service nova] Creating event network-changed:384961f9-0f01-4d12-864e-a14aa382c228 for instance d082780b-e2a5-480f-9edf-5793b00ce795 on hv-cinder-85367 Aug 18 17:15:23.526283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-7cbab533-7eec-4f55-9e0f-2cab4467a3be req-5f57fd08-9e31-4842-9e89-d2818f0118ea service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Aug 18 17:15:23.527107 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 200/392] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:23.694194 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:23.694741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:23.695313 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:23.696358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:23.710773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.711726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.712408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.713574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.714240 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.714923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.719636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.723460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.723986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.725124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.726760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.727313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:24.179316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:24.188908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0d7e40f5-07ce-4d7d-893e-d54678c66d68 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.509285 Aug 18 17:15:24.204341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 193/393] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:23 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:24.211650 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-453dd311-c457-4990-8df3-b3e01c1b6321 req-4770aef5-4c8a-4761-b109-62bcfde08cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4db630-6d52-4c0a-b0d8-a333d29a985f", "name": "network-vif-plugged", "status": "completed", "tag": "f48a6257-e15d-44f2-bdf5-33de18937e1f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:24.212598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:24.223189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-453dd311-c457-4990-8df3-b3e01c1b6321 req-4770aef5-4c8a-4761-b109-62bcfde08cd9 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:24.223934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-453dd311-c457-4990-8df3-b3e01c1b6321 req-4770aef5-4c8a-4761-b109-62bcfde08cd9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:24.224369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-453dd311-c457-4990-8df3-b3e01c1b6321 req-4770aef5-4c8a-4761-b109-62bcfde08cd9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:24.225080 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e72d1a5a-0a8c-4550-b51a-f3b13fc08da7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.535982 Aug 18 17:15:24.227532 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 201/394] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:23 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:24.236837 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-453dd311-c457-4990-8df3-b3e01c1b6321 req-4770aef5-4c8a-4761-b109-62bcfde08cd9 service nova] Creating event network-vif-plugged:f48a6257-e15d-44f2-bdf5-33de18937e1f for instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f on hv-cinder-85367 Aug 18 17:15:24.243642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-453dd311-c457-4990-8df3-b3e01c1b6321 req-4770aef5-4c8a-4761-b109-62bcfde08cd9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037294 Aug 18 17:15:24.244220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 194/395] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:25.209519 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:25.211287 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:25.219792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.224382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.224838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.225575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.226036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.226457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.248681 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:25.249553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:25.265572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.266351 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.266870 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.268599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.269013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.270593 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.522929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:25.548224 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:25.555136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7fc61007-97ef-4d4d-b233-8c347bd900fb tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.312833 Aug 18 17:15:25.555723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 195/396] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:25 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:25.556432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-20f8481e-f8b6-4228-a6fb-d6ba5a734a59 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.350653 Aug 18 17:15:25.557019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 202/397] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:25 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:26.576982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:26.577545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:26.579054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:26.579799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:26.585580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.586019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.586133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.586496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.586622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.586942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.587645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.587889 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.588114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.588352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.588534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.588786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.792300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:26.795412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:26.803513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:26.810289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-deb854f9-91c8-4360-9586-64f9529e22d3 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.235091 Aug 18 17:15:26.810876 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 203/398] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:26 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:26.811178 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f4782bd7-c64b-4d86-ae69-e05b1a142ac0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.238274 Aug 18 17:15:26.824253 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 196/399] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:26 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:27.832116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:27.833697 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:27.840740 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.841481 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.841907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.842836 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.843691 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.844273 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.852009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:27.852720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:27.860161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.865214 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.865665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.866381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.866836 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.867287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:28.119380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:28.122836 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:28.132023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e6cf13eb-9f5c-40dd-992f-43ea501aff95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.303423 Aug 18 17:15:28.147303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-43d9c6f4-d00b-4795-b88a-6600b19d33c7 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.311269 Aug 18 17:15:28.149195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 204/400] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:27 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:28.151406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 197/401] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:27 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:29.156160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:29.156766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:29.163253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=12 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:29.163921 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:29.165730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.166408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.166864 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.167988 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:29.168516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.168516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.168516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.169163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:29.178889 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:29.181146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.181732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.182262 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.183248 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.183854 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.184393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.619586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:29.623192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:29.631244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-12108b34-ca2f-49a1-8f4d-e48a27f97ad1 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.471430 Aug 18 17:15:29.637460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 198/402] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:29 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:29.637674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-21c3ace4-683f-4199-bd22-ef831c80d336 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.482242 Aug 18 17:15:29.637674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 205/403] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:29 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:30.670371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:30.672508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:30.681014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:30.683457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:30.697793 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:30.700368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:30.700368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:30.700678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:30.700678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:30.700678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:30.701148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:30.701601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:30.702194 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:30.706348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:30.707926 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:30.710025 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:30.710466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:30.962355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:30.966474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:30.976029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b40270d4-eff0-481d-9e52-90718b8f96f0 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.313946 Aug 18 17:15:30.977806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-eb7f6006-8020-4853-9b04-ac5567892080 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.316438 Aug 18 17:15:30.978655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 199/404] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:30 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:30.989498 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 206/405] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:30 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:31.759797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "675d5524-e9fd-4f56-a749-78c7c6c94826", "device": "/dev/sdb"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:31.762931 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:31.769004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=10 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:31.772286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.772958 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.773390 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.774088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.774534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.774980 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.997084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:31.997709 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:32.004226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.004713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.005143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.005828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.006273 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.006686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.183699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:32.191642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fa618eab-89e8-4982-b0f0-8ee9a62889b5 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1313 microversion: 2.1 time: 0.198460 Aug 18 17:15:32.192341 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 207/406] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:31 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:32.197530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:32.198144 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:32.203823 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.204309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.204735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.205425 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.205884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.206309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.344276 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:32.356482 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6710f2fd-4bc8-4fe8-95df-dde0be1271ca tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.162960 Aug 18 17:15:32.357152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 208/407] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:32 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:33.213140 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:33.213904 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:33.220691 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:33.221723 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:33.221723 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:33.222299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:33.223297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:33.223727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:33.317440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-22d7f62d-b433-4086-a3fe-da2ed24fa53e tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "POST /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.563393 Aug 18 17:15:33.320917 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 200/408] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:15:31 2022] POST /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3/os-volume_attachments => generated 194 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:33.386524 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:33.387266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:33.393739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:33.395008 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:33.395667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:33.396545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:33.397164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:33.397597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:33.414042 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:33.422667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e480ab77-14de-4238-9d40-3cafc9b31ebb tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1496 microversion: 2.1 time: 0.213779 Aug 18 17:15:33.426202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 209/409] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:33 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1496 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:33.551427 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:33.567221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a0203790-20d1-4ec2-b8da-13cfbc2ad219 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.188366 Aug 18 17:15:33.569435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 201/410] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:33 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:34.085905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-738818a1-f307-4400-ad96-a37efc158b4b req-7b03cbe8-398d-47de-ae3c-0688e8b8056d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d082780b-e2a5-480f-9edf-5793b00ce795", "name": "network-vif-plugged", "status": "completed", "tag": "384961f9-0f01-4d12-864e-a14aa382c228"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:34.097577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-738818a1-f307-4400-ad96-a37efc158b4b req-7b03cbe8-398d-47de-ae3c-0688e8b8056d service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.098856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-738818a1-f307-4400-ad96-a37efc158b4b req-7b03cbe8-398d-47de-ae3c-0688e8b8056d service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.099885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-738818a1-f307-4400-ad96-a37efc158b4b req-7b03cbe8-398d-47de-ae3c-0688e8b8056d service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.113014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-738818a1-f307-4400-ad96-a37efc158b4b req-7b03cbe8-398d-47de-ae3c-0688e8b8056d service nova] Creating event network-vif-plugged:384961f9-0f01-4d12-864e-a14aa382c228 for instance d082780b-e2a5-480f-9edf-5793b00ce795 on hv-cinder-85367 Aug 18 17:15:34.118671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-738818a1-f307-4400-ad96-a37efc158b4b req-7b03cbe8-398d-47de-ae3c-0688e8b8056d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042126 Aug 18 17:15:34.119522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 210/411] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:15:34.458053 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:34.458675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:34.465892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:34.470380 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.470380 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.470380 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.471146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.471718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.472155 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.503200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:15:34.592258 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:34.593095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:34.600658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.601367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.601976 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.603109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.603735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.604165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.814761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:34.824504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4d06a02d-6a93-4283-a025-39f44539942c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.237326 Aug 18 17:15:34.825831 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 211/412] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:34 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:34.839185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f3c5b6d4-1a66-4123-a342-e25173f9924a tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 204 len: 0 microversion: 2.1 time: 0.384627 Aug 18 17:15:34.839778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 202/413] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:15:34 2022] DELETE /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:15:34.849830 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:34.850686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:34.857981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.859226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.860832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.861742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.863451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.864126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:35.003275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:35.011992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b3d51d67-85a2-4770-aaf6-e012454610b9 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1502 microversion: 2.1 time: 0.167314 Aug 18 17:15:35.012565 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 212/414] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:34 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:35.846149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:35.847240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:35.867750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:35.868411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:35.868857 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:35.869678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:35.870134 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:35.870559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:36.016881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:36.025785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-67b351cb-ba23-40e4-98ab-d02a8ff20c13 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.183824 Aug 18 17:15:36.026629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 203/415] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:35 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:36.040549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:36.041166 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:36.047333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:36.047821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:36.048256 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:36.048963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:36.049418 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:36.049844 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:36.225913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:36.241353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4a4fb195-c27d-4e91-a573-5e79ce97ff2b tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1502 microversion: 2.1 time: 0.204501 Aug 18 17:15:36.241966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 213/416] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:36 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:37.048877 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:37.049503 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:37.057968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:37.058512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:37.059049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:37.059967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:37.060719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:37.061476 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:37.228590 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:37.236425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-27dd4474-afe6-4ca3-8bcf-f725e86e8202 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.191562 Aug 18 17:15:37.236996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 204/417] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:37 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:37.264506 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:37.265044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:37.272104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:37.272638 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:37.273368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:37.274214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:37.274732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:37.275236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:37.421038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:37.430429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-758cc192-5caa-47b1-8731-f2e2836032e6 tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1502 microversion: 2.1 time: 0.169801 Aug 18 17:15:37.431021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 214/418] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:37 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:38.258679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:38.259975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:38.279088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:38.279778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:38.283014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:38.285895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:38.285895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:38.285895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:38.389194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-4db86d2c-6ee8-41fd-92fe-2238bdd13ef9 req-2af1da72-0d4d-47bd-90aa-5eaac63b6549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4db630-6d52-4c0a-b0d8-a333d29a985f", "name": "network-vif-deleted", "tag": "f48a6257-e15d-44f2-bdf5-33de18937e1f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:38.403938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-4db86d2c-6ee8-41fd-92fe-2238bdd13ef9 req-2af1da72-0d4d-47bd-90aa-5eaac63b6549 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:38.404620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-4db86d2c-6ee8-41fd-92fe-2238bdd13ef9 req-2af1da72-0d4d-47bd-90aa-5eaac63b6549 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:38.405156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-4db86d2c-6ee8-41fd-92fe-2238bdd13ef9 req-2af1da72-0d4d-47bd-90aa-5eaac63b6549 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:38.420383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-4db86d2c-6ee8-41fd-92fe-2238bdd13ef9 req-2af1da72-0d4d-47bd-90aa-5eaac63b6549 service nova] Creating event network-vif-deleted:f48a6257-e15d-44f2-bdf5-33de18937e1f for instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f on hv-cinder-85367 Aug 18 17:15:38.426643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-4db86d2c-6ee8-41fd-92fe-2238bdd13ef9 req-2af1da72-0d4d-47bd-90aa-5eaac63b6549 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043429 Aug 18 17:15:38.427625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 215/419] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:15:38.459487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:38.459924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:38.468444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:38.469045 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:38.469577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:38.470397 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:38.470975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:38.471741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:38.518495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:38.527958 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-22e04cf7-5ebf-4e80-94ed-ba1326f9c4c9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1372 microversion: 2.1 time: 0.274414 Aug 18 17:15:38.546106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 205/420] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:38 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:38.588834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f5cef83ff4fe69e00e3ccf703088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e161860d18f4d608a9ce4177cce7b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:38.598774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-838d3846-a1a1-4c3b-8eb2-05128aba34fc tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 200 len: 1460 microversion: 2.1 time: 0.149487 Aug 18 17:15:38.601776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 216/421] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:38 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:39.570267 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:39.570992 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:39.577794 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:39.578568 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:39.579534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:39.580452 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:39.580983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:39.581616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:39.632034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:39.633244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] [instance: 1c4db630-6d52-4c0a-b0d8-a333d29a985f] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:39.650468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:39.651180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:39.651985 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:39.654094 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:39.655049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:39.655820 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:39.679046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] HTTP exception thrown: Instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f could not be found. Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Request method failure captured: Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f HTTP/1.1 Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nNtjTcLlUFMYNxLPbYtdj5je-15af1QV4LpKe7NvJdwQv3QwxV3OVLxaxWj_xcK3zh-TDPOHbkFOh_ApfEEewVIcVt1zph4IetMwq3VhsojMBRiPmgbgFpn_gKvG9fLoJrbQLbAZ-lYTZ_rlrHGktmr7QmtY-8mMki1_nkNZGrUsVY Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 9e161860d18f4d608a9ce4177cce7b6f Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesActionsTest-353265711 Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:15:39.688965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9e161860d18f4d608a9ce4177cce7b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesActionsTest-353265711 Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 9e161860d18f4d608a9ce4177cce7b6f Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesActionsTest-353265711 Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesActionsTest-353265711-project Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 497f5cef83ff4fe69e00e3ccf703088d Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesActionsTest-353265711-project Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f could not be found. Aug 18 17:15:39.690563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '1c4db630-6d52-4c0a-b0d8-a333d29a985f'} Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f could not be found. Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:15:39.691351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f could not be found. Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f could not be found. Aug 18 17:15:39.692535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:15:39.696237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] Returning 404 to user: Instance 1c4db630-6d52-4c0a-b0d8-a333d29a985f could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:15:39.696237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-78610565-1894-40bc-aee4-d50dffb410bd tempest-VolumesActionsTest-353265711 tempest-VolumesActionsTest-353265711-project] 10.222.0.82 "GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f" status: 404 len: 111 microversion: 2.1 time: 0.058031 Aug 18 17:15:39.696237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 217/422] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:39 2022] GET /compute/v2.1/servers/1c4db630-6d52-4c0a-b0d8-a333d29a985f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:15:39.840613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:39.865981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0f6d0d31-95c2-44d7-a386-5a89aa19886b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1565 microversion: 2.1 time: 0.283532 Aug 18 17:15:39.865981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 206/423] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:39 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1565 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:39.887020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:39.887510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:39.901695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:39.902434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:39.911722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:39.912774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:39.913670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:39.918958 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:40.066822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2598bab7-022b-4a85-bb74-e79752e54e6c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199841 Aug 18 17:15:40.074761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 218/424] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:15:39 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:41.913597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-7d0b6ea3-77b8-47db-9022-37c3c89865f0 req-a1c707ef-435c-4380-aa3f-09ba6894ecb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d082780b-e2a5-480f-9edf-5793b00ce795", "tag": "384961f9-0f01-4d12-864e-a14aa382c228"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:41.953303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7d0b6ea3-77b8-47db-9022-37c3c89865f0 req-a1c707ef-435c-4380-aa3f-09ba6894ecb5 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:41.954662 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7d0b6ea3-77b8-47db-9022-37c3c89865f0 req-a1c707ef-435c-4380-aa3f-09ba6894ecb5 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:41.955444 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7d0b6ea3-77b8-47db-9022-37c3c89865f0 req-a1c707ef-435c-4380-aa3f-09ba6894ecb5 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:41.970578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-7d0b6ea3-77b8-47db-9022-37c3c89865f0 req-a1c707ef-435c-4380-aa3f-09ba6894ecb5 service nova] Creating event network-changed:384961f9-0f01-4d12-864e-a14aa382c228 for instance d082780b-e2a5-480f-9edf-5793b00ce795 on hv-cinder-85367 Aug 18 17:15:41.976861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-7d0b6ea3-77b8-47db-9022-37c3c89865f0 req-a1c707ef-435c-4380-aa3f-09ba6894ecb5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067516 Aug 18 17:15:41.984239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 207/425] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:48.627362 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a83f40fe-1325-4fdb-8952-c5bf61074582 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Action: 'create', calling method: .version_select at 0x7fd1f2e8ce50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-959238922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhEUUccKSPKDDUbK5Wq5OUi0CIRzLNLdJtTlslEK3/BaAdK0aFq34gQh9nHX9tVVqYjqqixv0JYa33nGX8pTgndCbA0USr6RLnnIEpUpYEkRYjDjNndNoakU6v3UiBMCA=="}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:48.643553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-a83f40fe-1325-4fdb-8952-c5bf61074582 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for project e976b3d87de347818a3c62fa4806db98. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:48.648480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-a83f40fe-1325-4fdb-8952-c5bf61074582 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for user 04ab53c336934355a0000bda59fa7e7c and project e976b3d87de347818a3c62fa4806db98. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:48.723131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a83f40fe-1325-4fdb-8952-c5bf61074582 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.277563 Aug 18 17:15:48.723131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 219/426] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:15:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:17.352485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:17.354592 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:17.360018 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1366280554", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2080356117", "security_groups": [{"name": "tempest-secgroup-smoke-89031342"}], "networks": [{"uuid": "57cac0d0-5d35-4c75-ab77-9fdda8e2fe61"}], "block_device_mapping_v2": [{"uuid": "7bd3fe6f-3eee-49cc-aeb8-a1a16e53e629", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:17.491968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] validate_networks() for [('57cac0d0-5d35-4c75-ab77-9fdda8e2fe61', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:16:17.911880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:16:17.912341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:16:17.913186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:16:17.913658 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:16:17.914259 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:16:17.923922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:17.924682 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:17.925387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:17.926405 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:17.927106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:17.927719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:17.948888 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Getting quotas for project f8802bed1f6b4be991ff011f40bf8622. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:16:17.952921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Getting quotas for user ebc5df40911b4186abec99c01e0702a6 and project f8802bed1f6b4be991ff011f40bf8622. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:16:18.014950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:16:18.017210 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bd3fe6f-3eee-49cc-aeb8-a1a16e53e629',volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:16:18.424784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c06bf068-b683-4100-b546-473d94828613 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.074396 Aug 18 17:16:18.425429 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 208/427] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:16:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:16:18.434103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=77 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:18.435009 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=4 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:18.435661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:18.439662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1991af56-5d00-4b5b-aad0-d3c15fefa72f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:18.441898 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1991af56-5d00-4b5b-aad0-d3c15fefa72f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:18.504853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1991af56-5d00-4b5b-aad0-d3c15fefa72f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:18.512894 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1991af56-5d00-4b5b-aad0-d3c15fefa72f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1089 microversion: 2.1 time: 0.080385 Aug 18 17:16:18.513454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 220/428] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:18 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:19.536189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3ee3c25d-724f-47dd-a157-d9077af66963 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:19.536783 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3ee3c25d-724f-47dd-a157-d9077af66963 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:19.595308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ee3c25d-724f-47dd-a157-d9077af66963 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:19.602497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3ee3c25d-724f-47dd-a157-d9077af66963 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1089 microversion: 2.1 time: 0.071937 Aug 18 17:16:19.603081 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 209/429] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:19 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:20.563020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:20.563556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:20.570529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.571029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.571462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.572141 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.572584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.573000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.624515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:20.625106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:20.632120 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.632611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.637777 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.637777 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.637777 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.637777 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.706261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:20.714423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-76eb402d-52fd-4f1f-a3d4-d70ebf4493b6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1187 microversion: 2.1 time: 0.094023 Aug 18 17:16:20.715884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 210/430] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:20 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:20.736157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lazy-loading 'services' on Instance uuid 82112920-df63-40b7-a941-0d5cc01d5fe3 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:16:21.044593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9e9c191b-79df-4a9e-8bc0-b9052427c97a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3/os-volume_attachments/675d5524-e9fd-4f56-a749-78c7c6c94826" status: 202 len: 0 microversion: 2.1 time: 0.486750 Aug 18 17:16:21.045203 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 221/431] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:16:20 2022] DELETE /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3/os-volume_attachments/675d5524-e9fd-4f56-a749-78c7c6c94826 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:16:21.736820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:21.737584 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:21.744091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:21.744570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:21.745006 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:21.745701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:21.746163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:21.746590 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:21.811819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:21.821482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2d11f097-5eb9-4e36-9f96-198994901c56 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1205 microversion: 2.1 time: 0.088576 Aug 18 17:16:21.828432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 211/432] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:21 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:22.846506 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:22.847340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:22.853728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:22.854676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:22.854676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:22.855352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:22.855803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:22.856488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:23.093535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:23.104620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8f91f257-a8aa-4586-99a9-e06d9d48c794 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1271 microversion: 2.1 time: 0.262530 Aug 18 17:16:23.105190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 222/433] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:22 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:23.257138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:23.257651 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:23.264303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:23.264803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:23.265243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:23.266005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:23.268765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:23.271660 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:23.295526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-43900e7d-1924-4be8-a6ae-a2ff3694df1d req-d114edcf-fec3-4c66-85ca-0dca48782aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:23.306416 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-43900e7d-1924-4be8-a6ae-a2ff3694df1d req-d114edcf-fec3-4c66-85ca-0dca48782aff service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:23.307150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-43900e7d-1924-4be8-a6ae-a2ff3694df1d req-d114edcf-fec3-4c66-85ca-0dca48782aff service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:23.307741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-43900e7d-1924-4be8-a6ae-a2ff3694df1d req-d114edcf-fec3-4c66-85ca-0dca48782aff service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:23.313808 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:16:23.319528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-43900e7d-1924-4be8-a6ae-a2ff3694df1d req-d114edcf-fec3-4c66-85ca-0dca48782aff service nova] Creating event network-changed:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:16:23.328413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-43900e7d-1924-4be8-a6ae-a2ff3694df1d req-d114edcf-fec3-4c66-85ca-0dca48782aff service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037227 Aug 18 17:16:23.335089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 223/434] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:23.713971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-116f5bad-dc9b-474a-9c0d-8da18971be34 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 204 len: 0 microversion: 2.1 time: 0.460452 Aug 18 17:16:23.714580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 212/435] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:16:23 2022] DELETE /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:16:23.724039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:23.724729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:23.730773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:23.731282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:23.731709 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:23.732842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:23.733319 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:23.733740 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:23.884971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:23.893037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-24a84673-2ba9-4709-85c4-7d91cf433ab1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1513 microversion: 2.1 time: 0.173054 Aug 18 17:16:23.893630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 224/436] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:23 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:24.127371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:24.128025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:24.134507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:24.135138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:24.135580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:24.136298 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:24.136755 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:24.137327 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:24.294325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:24.303595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1e190106-5082-4ab3-9773-b0e3d503eec9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.181416 Aug 18 17:16:24.304176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 213/437] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:24 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:24.914755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:24.915412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:24.922342 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:24.922829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:24.923332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:24.924051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:24.924531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:24.924979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:25.056974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:25.064800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f6855761-8f8e-467a-b092-6084cc7662cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1513 microversion: 2.1 time: 0.153899 Aug 18 17:16:25.065359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 225/438] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:24 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:25.324093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:25.324711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:25.332197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:25.332678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:25.333416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:25.333878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:25.334368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:25.334798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:25.553624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:25.561523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4b057559-6b2a-4736-98ba-5f87ec52fdcf tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.241271 Aug 18 17:16:25.562163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 214/439] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:25 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:26.086153 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:26.086792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:26.092809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:26.093439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:26.093873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:26.094583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:26.095066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:26.095484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:26.228175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:26.236575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a23aed19-0c62-47e8-b90d-65d6be83b5ab tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1513 microversion: 2.1 time: 0.154160 Aug 18 17:16:26.237147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 226/440] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:26 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:26.583646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:26.584286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:26.591424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:26.591915 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:26.592353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:26.593648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:26.594118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:26.594524 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:26.734796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:26.742438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-94b02d44-90a4-4df0-87cc-521771ac3aac tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.162818 Aug 18 17:16:26.743025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 215/441] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:26 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:27.257352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:27.257966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:27.265490 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:27.266003 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:27.266452 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:27.267214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:27.267675 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:27.268100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:27.401005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:27.408949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-af4fc7ef-2edd-4b80-89d6-963cc16aed8b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1513 microversion: 2.1 time: 0.155464 Aug 18 17:16:27.409510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 227/442] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:27 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:27.763220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:27.763734 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:27.770440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:27.770920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:27.771374 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:27.772057 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:27.772504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:27.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:27.905805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:27.914068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-908184cd-1e8b-4aa7-8aae-110f0da6c8af tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.154907 Aug 18 17:16:27.914628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 216/443] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:27 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:28.430496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:28.431128 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:28.438357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:28.439145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:28.439960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:28.440695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:28.441175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:28.441590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:28.647990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:28.656127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-efb6f392-192d-4ce7-9f7f-7427301c7ff4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1513 microversion: 2.1 time: 0.229802 Aug 18 17:16:28.657473 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 228/444] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:28 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:28.931189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-9bff5237-3f20-4a37-8b8f-10248fe808ee req-3dfc6548-31f0-4e19-976e-5fd4507a2642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82112920-df63-40b7-a941-0d5cc01d5fe3", "name": "network-vif-deleted", "tag": "66eb0809-6d6b-4fe8-bd51-a7ba888689fe"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:28.938057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:28.938720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:28.939690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:28.944707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:28.945184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:28.945605 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:28.945714 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9bff5237-3f20-4a37-8b8f-10248fe808ee req-3dfc6548-31f0-4e19-976e-5fd4507a2642 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:28.946122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9bff5237-3f20-4a37-8b8f-10248fe808ee req-3dfc6548-31f0-4e19-976e-5fd4507a2642 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:28.946289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:28.946555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9bff5237-3f20-4a37-8b8f-10248fe808ee req-3dfc6548-31f0-4e19-976e-5fd4507a2642 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:28.946730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:28.947170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:28.958200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-9bff5237-3f20-4a37-8b8f-10248fe808ee req-3dfc6548-31f0-4e19-976e-5fd4507a2642 service nova] Creating event network-vif-deleted:66eb0809-6d6b-4fe8-bd51-a7ba888689fe for instance 82112920-df63-40b7-a941-0d5cc01d5fe3 on hv-cinder-85367 Aug 18 17:16:28.963625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-9bff5237-3f20-4a37-8b8f-10248fe808ee req-3dfc6548-31f0-4e19-976e-5fd4507a2642 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036242 Aug 18 17:16:28.964276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 217/445] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:29.086198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:29.094870 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fbe35c12-dad2-4217-94ec-ed44c15f61e9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.160825 Aug 18 17:16:29.095586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 229/446] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:28 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:29.675458 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=8 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:29.679989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:29.680687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:29.687071 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:29.687494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:29.688671 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:29.689399 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:29.689871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:29.690315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:29.723035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:29.723518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:29.723950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:29.724406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lazy-loading 'fault' on Instance uuid 82112920-df63-40b7-a941-0d5cc01d5fe3 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:16:29.768334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:29.776121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-17e8e72b-0ef2-4002-8759-b9f6d3d940b4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 200 len: 1309 microversion: 2.1 time: 0.101655 Aug 18 17:16:29.777117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 218/447] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:29 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:30.116940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:30.117566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:30.123734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:30.124281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:30.124717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:30.125429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:30.125883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:30.126309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:30.261318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:30.269559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f6974b07-1585-488b-8444-f243c46f723e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.157110 Aug 18 17:16:30.270123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 230/448] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:30 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:30.798136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:30.798746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 82112920-df63-40b7-a941-0d5cc01d5fe3] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:30.805146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:30.805625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:30.806058 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:30.806740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:30.807220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:30.807645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:30.821701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] HTTP exception thrown: Instance 82112920-df63-40b7-a941-0d5cc01d5fe3 could not be found. Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Request method failure captured: Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 HTTP/1.1 Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nN3ukIe8-wTTw-PjMzkoj0S3nEFycw0fX-smVDSjd9-Ta1IhE0qkBkjji3xiFZj1bVJCKXQp7zsp0VsxOPfgOaQXdGVvXayLOqiG6augfoEmZsgCGGfYWylTZ8o1jE_pGF54GqICAMhW2T0x6xi5X84lv7vNNAAHbaR0nqQODRSelI Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 420292ae9c0547cc9755f24c23d419c3 Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1461234341 Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:16:30.823353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesSnapshotTestJSON-1461234341 Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 420292ae9c0547cc9755f24c23d419c3 Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1461234341 Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesSnapshotTestJSON-1461234341-project Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 32f58f87972d46be9496e6216f1f5ca1 Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesSnapshotTestJSON-1461234341-project Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 82112920-df63-40b7-a941-0d5cc01d5fe3 could not be found. Aug 18 17:16:30.824904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '82112920-df63-40b7-a941-0d5cc01d5fe3'} Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82112920-df63-40b7-a941-0d5cc01d5fe3 could not be found. Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:16:30.825756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82112920-df63-40b7-a941-0d5cc01d5fe3 could not be found. Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82112920-df63-40b7-a941-0d5cc01d5fe3 could not be found. Aug 18 17:16:30.827567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:16:30.828844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Returning 404 to user: Instance 82112920-df63-40b7-a941-0d5cc01d5fe3 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:16:30.828844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e6464f38-53d6-4bf7-8412-d99e2bb5ca3a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3" status: 404 len: 111 microversion: 2.1 time: 0.031064 Aug 18 17:16:30.828844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 219/449] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:30 2022] GET /compute/v2.1/servers/82112920-df63-40b7-a941-0d5cc01d5fe3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:16:31.290594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:31.291234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:31.293159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:31.299382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:31.300944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:31.300944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:31.301318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:31.301774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:31.302198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:31.454194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:31.462358 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9f6197c0-d80f-46c4-aa80-e73c3e7072f9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.175593 Aug 18 17:16:31.462941 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 231/450] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:31 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:32.483563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:32.484131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:32.490687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:32.491196 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:32.491627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:32.492304 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:32.492751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:32.493169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:32.626454 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:32.639507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1a543ebc-d167-4fdd-b6d0-87c0d9739e78 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.159657 Aug 18 17:16:32.640071 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 220/451] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:32 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:33.659419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:33.660038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:33.665882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:33.666355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:33.666785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:33.667495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:33.667945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:33.668363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:33.800093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:33.807881 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-110a5a7f-a572-4dd1-ba71-f3ef77bb1632 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.152438 Aug 18 17:16:33.808509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 232/452] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:33 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:34.828976 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:34.829589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:34.836684 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:34.837163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:34.837595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:34.838285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:34.838739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:34.839192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:34.968768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:34.979306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d99c66c5-2033-45fe-bb98-d38d98a08252 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.154131 Aug 18 17:16:34.979864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 221/453] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:34 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:35.999984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:36.000593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:36.006876 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:36.007385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:36.007821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:36.008648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:36.009102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:36.009527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:36.138199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:36.146002 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-605e8955-5181-43f6-bccd-95ae4c03b067 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.149827 Aug 18 17:16:36.146552 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 233/454] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:35 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:37.166244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:37.166859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:37.173528 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:37.173999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:37.174430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:37.175674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:37.176118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:37.176532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:37.305207 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:37.312797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a8883a30-523a-48af-a22c-aa6e8aa3c13b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.150333 Aug 18 17:16:37.313350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 222/455] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:37 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:37.524136 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:37.524631 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:37.530525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:37.531048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:37.531484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:37.532170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:37.532636 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:37.533044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:37.555900 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-80af6ebd-5a27-49d8-b218-bf87b7e8455a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/ips" status: 200 len: 152 microversion: 2.20 time: 0.035769 Aug 18 17:16:37.556459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 234/456] 10.222.0.82 () {60 vars in 1289 bytes} [Thu Aug 18 17:16:37 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:16:38.333637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:38.334272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:38.340886 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:38.341368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:38.341803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:38.342496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:38.342973 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:38.343402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:38.480079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:38.487676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-87894437-f805-42cb-9bd5-30c41ec82aff tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.158138 Aug 18 17:16:38.488229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 223/457] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:38 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:39.511324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:39.512868 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:39.521218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:39.521699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:39.522130 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:39.522824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:39.523344 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:39.523770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:39.675372 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:39.684057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6c7a1972-aa55-4a3f-9af4-69f5214a812e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.179090 Aug 18 17:16:39.684626 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 235/458] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:39 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:40.705209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:40.705816 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:40.712675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:40.713151 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:40.713579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:40.714414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:40.714708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:40.715169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:40.853948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:40.861629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ede9a8f1-8954-43cd-be44-a53ef1faec69 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.160238 Aug 18 17:16:40.862184 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 224/459] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:40 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:41.882022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:41.882637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:41.889068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:41.889573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:41.890030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:41.890718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:41.891188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:41.891606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:42.024729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:42.032285 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-97395aaf-4754-4719-be24-d022515cfb5f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.154792 Aug 18 17:16:42.032838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 236/460] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:41 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:42.946892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:42.947720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:42.954257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:42.954862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:42.966934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:42.966934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:42.966934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:42.966934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:42.974811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:42.981369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lazy-loading 'flavor' on Instance uuid a30b49e2-6995-4078-b762-0ac46cc2b043 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:16:43.053192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:43.054068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:43.059940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:43.060414 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:43.060841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:43.061528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:43.061973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:43.062434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:43.207059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:43.211127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:43.216515 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9e063806-a1b5-48f6-9d25-487c900b3721 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.167315 Aug 18 17:16:43.217185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 237/461] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:43 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:43.520131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1f9cc2e7-76ca-49f0-beea-8b53404f0d89 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/action" status: 202 len: 0 microversion: 2.20 time: 0.578334 Aug 18 17:16:43.521412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 225/462] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 17:16:42 2022] POST /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:16:43.530228 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:43.530834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:43.537375 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:43.537852 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:43.538283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:43.539012 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:43.539456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:43.539874 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:43.670458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:43.678952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:43.680447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:43.681633 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-649de4e8-482f-4d88-9afe-1ce322b6b79d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.155643 Aug 18 17:16:43.682184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 238/463] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:43 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:44.231308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1362676594", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-959238922", "security_groups": [{"name": "tempest-secgroup-smoke-1712538356"}], "block_device_mapping_v2": [{"uuid": "5ee49942-da8a-417e-8963-08f3bb1ed951", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0c6229eb-eed2-4407-a072-5471b2488cad"}]}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:44.237967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:44.238595 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:44.245312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:44.245806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:44.246236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:44.247873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:44.247873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:44.248042 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:44.397105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] validate_networks() for [('0c6229eb-eed2-4407-a072-5471b2488cad', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:16:44.469892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:44.478343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3609b811-f5d3-466f-928d-d08f87664ac5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.244273 Aug 18 17:16:44.478957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 239/464] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:44 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:44.704378 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:44.704986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:44.711631 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:44.712110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:44.712545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:44.713238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:44.713704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:44.714123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:44.835753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:16:44.836180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:16:44.836653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:16:44.837055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:16:44.837491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:16:44.846629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:44.847180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:44.847619 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:44.848383 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:44.848835 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:44.849955 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:44.865535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:44.866965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for project e976b3d87de347818a3c62fa4806db98. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:16:44.871083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for user 04ab53c336934355a0000bda59fa7e7c and project e976b3d87de347818a3c62fa4806db98. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:16:44.873652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:44.875161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:44.876325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4e7b5e55-1579-408c-98a8-21b14a00774b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.175875 Aug 18 17:16:44.876877 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 240/465] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:44 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:16:44.928420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:16:44.930688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ee49942-da8a-417e-8963-08f3bb1ed951',volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:16:45.289853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-913d34d8-7b61-416c-821a-142eda94b061 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.063205 Aug 18 17:16:45.290650 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 226/466] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:16:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:16:45.303890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d824d97f-4ed2-46d3-b5bf-c7a1dd408bcd tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:45.306126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d824d97f-4ed2-46d3-b5bf-c7a1dd408bcd tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:45.360946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d824d97f-4ed2-46d3-b5bf-c7a1dd408bcd tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:45.367775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d824d97f-4ed2-46d3-b5bf-c7a1dd408bcd tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1094 microversion: 2.1 time: 0.067824 Aug 18 17:16:45.368376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 241/467] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:45 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:45.498141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:45.498753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:45.505010 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:45.505494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:45.506101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:45.506798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:45.507302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:45.507727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:45.642509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:45.651547 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e8442a07-c341-4e0c-8d87-81c1a4ac9d20 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.157384 Aug 18 17:16:45.652108 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 227/468] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:45 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:45.899594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:45.900199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:45.906145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:45.906651 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:45.907110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:45.907827 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:45.908274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:45.908699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:46.039627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:46.048060 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:46.049728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:46.050883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8d7216c8-2b65-4723-bb8b-10e83a3edfe9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.155238 Aug 18 17:16:46.051460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 242/469] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:45 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:46.388556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:46.389176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:46.395552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:46.396035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:46.396466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:46.397931 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:46.398386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:46.398813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:46.459002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:46.466756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d36cb209-864a-470d-bb96-14d78fdbbf47 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1144 microversion: 2.1 time: 0.082376 Aug 18 17:16:46.467344 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 228/470] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:46 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:46.676383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:46.676989 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:46.683521 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:46.683998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:46.684539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:46.685262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:46.685716 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:46.686138 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:46.818154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:46.826142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d8636671-ab7a-4942-80f6-2bdfe7e07f23 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.157361 Aug 18 17:16:46.826698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 243/471] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:46 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:47.074858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:47.075492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:47.081418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:47.081897 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:47.082321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:47.083033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:47.083480 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:47.083898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:47.215778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:47.222237 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:47.223780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:47.224961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c2bfd12c-5e5d-47d9-ace2-86c286d4d3f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.154612 Aug 18 17:16:47.225552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 229/472] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:47 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:47.488024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:47.488621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:47.494717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:47.495218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:47.495647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:47.496327 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:47.496775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:47.497192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:47.559970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:47.567546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f77fc42c-f43c-4ed3-a8a1-ba13f06d8e1d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1144 microversion: 2.1 time: 0.083339 Aug 18 17:16:47.568099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 244/473] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:47 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:47.847470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:47.848084 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:47.850464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:47.855268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:47.855746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:47.856183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:47.856879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:47.857335 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:47.857753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:48.202143 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:48.210512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c92c6789-b752-49c0-865d-db71a681efb7 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.366257 Aug 18 17:16:48.211099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 230/474] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:47 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:48.247625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:48.248236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:48.254095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:48.254577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:48.255110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:48.255812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:48.256346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:48.257467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:48.386231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:48.394552 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:48.396187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:48.397977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-99415dd4-7eae-47ea-b112-1c0650ce02c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.153579 Aug 18 17:16:48.398538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 245/475] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:48 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:48.589121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:48.589726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:48.595617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:48.596124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:48.596554 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:48.597407 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:48.597853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:48.598272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:48.660001 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:48.667710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7aaeab97-5cfa-43b5-a965-3c21e204a816 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1144 microversion: 2.1 time: 0.083201 Aug 18 17:16:48.668270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 231/476] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:48 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:49.231716 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:49.232317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:49.238164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:49.238633 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:49.239233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:49.239913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:49.240357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:49.240821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:49.369255 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:49.377077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-af057dc6-8ee1-47a4-b49f-8ba97dac05b9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.149189 Aug 18 17:16:49.378590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 246/477] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:49 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:49.421350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:49.422321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:49.429405 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:49.430035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:49.430464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:49.431191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:49.431630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:49.432050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:49.564694 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:49.573153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:49.574644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:49.575824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d5196c1c-75c7-4ebb-8013-8bdf8d16318b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.158328 Aug 18 17:16:49.576381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 232/478] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:49 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:49.688440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:49.689059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:49.695237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:49.695722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:49.696161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:49.696847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:49.697300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:49.697726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:49.756791 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:49.764760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cd06dce3-25e3-445a-bfb3-2f94875293de tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1144 microversion: 2.1 time: 0.080212 Aug 18 17:16:49.765348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 247/479] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:49 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:50.213233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-0265023b-96a5-4aa4-976c-7d39cf78ab72 req-8c13e2c1-fa1f-4c5b-9f9a-66e35333ec32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "name": "network-vif-plugged", "status": "completed", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:50.223357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0265023b-96a5-4aa4-976c-7d39cf78ab72 req-8c13e2c1-fa1f-4c5b-9f9a-66e35333ec32 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.223823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0265023b-96a5-4aa4-976c-7d39cf78ab72 req-8c13e2c1-fa1f-4c5b-9f9a-66e35333ec32 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.224269 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-0265023b-96a5-4aa4-976c-7d39cf78ab72 req-8c13e2c1-fa1f-4c5b-9f9a-66e35333ec32 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:50.238502 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-0265023b-96a5-4aa4-976c-7d39cf78ab72 req-8c13e2c1-fa1f-4c5b-9f9a-66e35333ec32 service nova] Creating event network-vif-plugged:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:16:50.249567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-0265023b-96a5-4aa4-976c-7d39cf78ab72 req-8c13e2c1-fa1f-4c5b-9f9a-66e35333ec32 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040278 Aug 18 17:16:50.251026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 233/480] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:16:50.397671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:50.399185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:50.407182 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.407906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.408484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:50.409193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.409839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.410268 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:50.559980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:50.570654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fc6567f9-1550-4d16-b5a7-b49c1bbe12bc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.175651 Aug 18 17:16:50.572301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 248/481] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:50 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:50.598075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1903815123", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "networks": [{"uuid": "4f606d5a-76c2-4d8b-b2b9-13fdf0a57fc9"}]}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:50.598959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:50.600193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:50.608112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.608822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.609138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:50.609844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.610306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.610733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:50.656430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] validate_networks() for [('4f606d5a-76c2-4d8b-b2b9-13fdf0a57fc9', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:16:50.870920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:50.879464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:50.880972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:50.882126 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3256dac7-c2e1-40b5-9532-797f13db7958 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.287902 Aug 18 17:16:50.883189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 234/482] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:50 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:50.887696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:50.888310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:50.897158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.897746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.899162 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:50.900664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:50.900664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:50.900985 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:51.021025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:51.029401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e194ef19-540e-4265-9130-2c150952a0d2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1192 microversion: 2.1 time: 0.145161 Aug 18 17:16:51.030017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 235/483] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:50 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1192 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:51.167139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:16:51.167558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:16:51.168024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:16:51.168427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:16:51.168832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:16:51.170763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=65 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:51.178237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:51.179247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:51.179247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:51.180725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:51.181173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:51.181592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:51.198496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Getting quotas for project 420292ae9c0547cc9755f24c23d419c3. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:16:51.202373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Getting quotas for user 32f58f87972d46be9496e6216f1f5ca1 and project 420292ae9c0547cc9755f24c23d419c3. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:16:51.213879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:16:51.216175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:16:51.309079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6511d1bd-09ac-4ead-91e6-53bd2ae56777 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714901 Aug 18 17:16:51.309715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 249/484] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:16:51.320747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-30fec9eb-a0cb-4f8a-9671-6362ccfb1779 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:51.321751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-30fec9eb-a0cb-4f8a-9671-6362ccfb1779 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:51.376816 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-30fec9eb-a0cb-4f8a-9671-6362ccfb1779 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:51.383891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-30fec9eb-a0cb-4f8a-9671-6362ccfb1779 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1219 microversion: 2.1 time: 0.067070 Aug 18 17:16:51.384465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 236/485] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:51 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:51.592661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:51.594190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:51.606726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:51.607203 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:51.607642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:51.608360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:51.608812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:51.609237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:51.763273 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:51.771450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9022319f-c12a-4227-863f-b29c0f64237b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.182711 Aug 18 17:16:51.772015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 250/486] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:51 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:51.907757 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:51.908353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:51.916117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:51.916594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:51.917025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:51.917744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:51.918192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:51.918613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.050621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:52.051822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:52.052441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:52.058458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:52.061927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:52.062046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:52.062160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.062160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:52.062160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:52.062401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:52.062514 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.062621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9f33ae1c-3dd1-4c6d-bab9-911d8c1014d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.158289 Aug 18 17:16:52.064738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 237/487] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:51 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:52.125980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:52.133885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7a29cfa2-c696-4e0c-8db5-076c45c648c8 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1210 microversion: 2.1 time: 0.086040 Aug 18 17:16:52.134457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 251/488] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:52 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:52.404783 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:52.405393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:52.411397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:52.411873 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:52.412303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.413020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:52.413498 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:52.413923 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.473751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:52.481851 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f4170a26-e373-4e02-97c2-93394ccab1a4 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1223 microversion: 2.1 time: 0.080880 Aug 18 17:16:52.482407 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 238/489] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:52 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:52.793643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:52.794435 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:52.800607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:52.801211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:52.801722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.802423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:52.802884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:52.803335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:52.999761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:53.007497 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d2f5d26d-4819-4665-92bc-a34ed01366d3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1259 microversion: 2.1 time: 0.218474 Aug 18 17:16:53.008759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 252/490] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:52 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:53.085287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:53.085965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:53.092285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:53.092798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:53.093230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:53.094975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:53.095438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:53.095867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:53.154549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:53.155194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:53.161381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:53.161738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:53.162176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:53.162870 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:53.163343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:53.163766 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:53.332965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:53.346289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:53.347855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:53.349079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-29345ccc-1bdb-446c-a1a6-d8593c496826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.267761 Aug 18 17:16:53.349652 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 239/491] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:53 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:53.416109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:53.424547 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-669e7307-9d81-460e-a48a-e1c3d09722ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1278 microversion: 2.1 time: 0.273796 Aug 18 17:16:53.425110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 253/492] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:53 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:53.503225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:53.503838 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:53.510030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:53.510509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:53.511002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:53.516276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:53.516276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:53.516276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:53.575163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:53.582783 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2d0bcc9d-04cf-4ff0-887c-bda3a18209cd tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1271 microversion: 2.1 time: 0.083693 Aug 18 17:16:53.583378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 240/493] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:53 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:54.034972 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:54.035633 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:54.042841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.043395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.044053 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.044895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.045354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.045781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.352668 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:54.362696 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dbc59ea8-40d9-4d94-a155-2fed35bfdfd3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1443 microversion: 2.1 time: 0.331566 Aug 18 17:16:54.363423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 254/494] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:54 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1443 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:54.374543 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:54.375881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:54.386871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.390916 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:54.391447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.391889 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.392604 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.393127 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.393564 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.394592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:54.401370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.402244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.402861 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.405148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.405609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.406457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.715457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:54.724020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:54.725882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:54.727292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a1158af4-5028-427d-bf78-c101a203bda7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.357180 Aug 18 17:16:54.739242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 241/495] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:54 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:54.739242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:54.739242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:54.742196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:54.742447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.742447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.742447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.742447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.750536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3de58797-4c45-4298-9a08-d21d3400ebbb tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1443 microversion: 2.1 time: 0.367522 Aug 18 17:16:54.751314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 255/496] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:54 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1443 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:54.759243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.759243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.772945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:54.773885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:54.780751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.781835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.782541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.783752 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.784433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.785064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.791146 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:54.812843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:54.857233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:54.929385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:54.940660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f6d899ff-945e-4a21-af37-e73cee0b9d4a tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1277 microversion: 2.1 time: 0.179771 Aug 18 17:16:54.941545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 256/497] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:54 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:54.947058 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-f6a49297-6025-46e7-ad42-4fdf8a8a60a0 req-fa75dcdd-991a-4a3b-b505-b882878ba52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1732a5ad-82ea-4429-ab40-0dd58302edd8", "tag": "0ec9e6c7-bd54-41cf-a346-2a13d678300a"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:54.957538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f6a49297-6025-46e7-ad42-4fdf8a8a60a0 req-fa75dcdd-991a-4a3b-b505-b882878ba52e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:54.958016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f6a49297-6025-46e7-ad42-4fdf8a8a60a0 req-fa75dcdd-991a-4a3b-b505-b882878ba52e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:54.958448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f6a49297-6025-46e7-ad42-4fdf8a8a60a0 req-fa75dcdd-991a-4a3b-b505-b882878ba52e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:54.971179 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-f6a49297-6025-46e7-ad42-4fdf8a8a60a0 req-fa75dcdd-991a-4a3b-b505-b882878ba52e service nova] Creating event network-changed:0ec9e6c7-bd54-41cf-a346-2a13d678300a for instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 on hv-cinder-85367 Aug 18 17:16:54.977649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-f6a49297-6025-46e7-ad42-4fdf8a8a60a0 req-fa75dcdd-991a-4a3b-b505-b882878ba52e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033802 Aug 18 17:16:54.978384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 257/498] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:55.123519 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:55.131279 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-04c19d2f-3e62-4280-b810-4e49f2c5552f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.402306 Aug 18 17:16:55.131848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 242/499] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:54 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:55.754343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:55.755122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:55.762839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:55.763653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:55.764310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:55.767055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:55.767722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:55.768339 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:55.963521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:55.966563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:55.974122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:55.974847 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:55.975966 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:55.977657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:55.978217 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:55.978654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:56.063526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:56.072601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:56.075527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:56.075527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-119dc1c5-e874-4823-afb9-d5cf5b6bca5d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.325320 Aug 18 17:16:56.076095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 258/500] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:55 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:56.152910 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:56.153554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:56.160489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:56.160931 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:56.161370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:56.162081 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:56.162542 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:56.162997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:56.261333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:56.269479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a5991494-6017-4f60-9d76-646e57191a1d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.311557 Aug 18 17:16:56.281070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 243/501] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:55 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:56.416333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:56.424813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fc3ac7bf-e804-4604-9fbd-402e753cbf19 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.275681 Aug 18 17:16:56.441463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 259/502] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:56 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:57.003101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-be4d8522-2963-4e74-952a-3fbb5cb0ed4e req-ec6185e2-5de9-4900-a64a-0794e86fe5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d7dd09-76eb-4636-8841-e6ea99bc8041", "tag": "bd911500-528f-49b1-89cb-1ad9bb0f6a37"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:57.004806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-29c6041b-7f4a-48c5-be13-3f4daeb42e6b req-601044c4-15f3-4f4c-a879-15e63cde3c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:57.014712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-be4d8522-2963-4e74-952a-3fbb5cb0ed4e req-ec6185e2-5de9-4900-a64a-0794e86fe5a7 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.014964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-29c6041b-7f4a-48c5-be13-3f4daeb42e6b req-601044c4-15f3-4f4c-a879-15e63cde3c54 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.015219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-be4d8522-2963-4e74-952a-3fbb5cb0ed4e req-ec6185e2-5de9-4900-a64a-0794e86fe5a7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.015478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-29c6041b-7f4a-48c5-be13-3f4daeb42e6b req-601044c4-15f3-4f4c-a879-15e63cde3c54 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.015935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-29c6041b-7f4a-48c5-be13-3f4daeb42e6b req-601044c4-15f3-4f4c-a879-15e63cde3c54 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.016088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-be4d8522-2963-4e74-952a-3fbb5cb0ed4e req-ec6185e2-5de9-4900-a64a-0794e86fe5a7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.028004 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-29c6041b-7f4a-48c5-be13-3f4daeb42e6b req-601044c4-15f3-4f4c-a879-15e63cde3c54 service nova] Creating event network-changed:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:16:57.028911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-be4d8522-2963-4e74-952a-3fbb5cb0ed4e req-ec6185e2-5de9-4900-a64a-0794e86fe5a7 service nova] Creating event network-changed:bd911500-528f-49b1-89cb-1ad9bb0f6a37 for instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 on hv-cinder-85367 Aug 18 17:16:57.033433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-29c6041b-7f4a-48c5-be13-3f4daeb42e6b req-601044c4-15f3-4f4c-a879-15e63cde3c54 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032152 Aug 18 17:16:57.034260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 260/503] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:57.034872 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-be4d8522-2963-4e74-952a-3fbb5cb0ed4e req-ec6185e2-5de9-4900-a64a-0794e86fe5a7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Aug 18 17:16:57.035639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 244/504] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:57.099121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:57.099879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:57.107220 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.107736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.108171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.108870 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.109329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.109754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.245983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:57.254236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:57.255748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:57.256907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-99ded881-8336-4373-b58a-cb5fc668b850 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.162130 Aug 18 17:16:57.257458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 261/505] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:57 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:57.292025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:57.292860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:57.299466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.299953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.300397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.301089 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.301544 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.302054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.436641 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:57.445833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cb39cd56-e9e9-4e1a-aa1b-c1d4333a4588 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.158596 Aug 18 17:16:57.449390 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:57.450315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:57.456352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.456958 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.457485 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.458284 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:57.458812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:57.459353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 245/506] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:57 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:57.459639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:57.596594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:57.604477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d75bf5e9-c0d7-4224-8fda-06fd9d0be867 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.159174 Aug 18 17:16:57.605051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 262/507] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:57 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:58.282842 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:58.285032 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:58.293556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:58.294186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:58.294742 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:58.295564 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:58.296104 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:58.296599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:58.465648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:58.466345 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:58.472816 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:58.473226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:58.473662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:58.474358 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:58.474807 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:58.475291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:58.836340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:58.845735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:58.847254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:58.848405 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e87112bb-6ab3-405f-b02e-b92488b27931 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.571342 Aug 18 17:16:58.848961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 246/508] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:58 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:16:58.868595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:58.869197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:58.875019 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:58.875516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:58.875950 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:58.877033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:58.877479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:58.877895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:59.165412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:59.174255 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e4f5f226-9556-47eb-9475-b47129bb0f68 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.712482 Aug 18 17:16:59.175014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 263/509] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:58 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:16:59.419072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:59.430095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-453012ef-8a21-4ea4-b7e5-7d378cf40903 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.562737 Aug 18 17:16:59.430095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 247/510] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:58 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:59.870806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:59.871478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:59.877354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:59.877827 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:59.878251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:59.878940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:59.879384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:59.879799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:00.018069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:00.027330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:00.028881 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:00.030349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a4fe6270-ddf0-4f03-9eb7-e1b36df1fa4d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.163438 Aug 18 17:17:00.030614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 264/511] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:16:59 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:00.195108 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:00.195773 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:00.201934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:00.202415 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:00.202852 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:00.203566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:00.204019 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:00.204535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:00.335447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:00.344031 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6c913629-da21-438c-b9d5-77ebbcf66533 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.153045 Aug 18 17:17:00.344602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 248/512] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:00 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:00.450044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:00.450575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:00.456553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:00.457967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:00.457967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:00.458166 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:00.458589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:00.459042 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:00.591075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:00.599015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e29ee8df-7c62-437b-85b1-d49140b57560 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.153625 Aug 18 17:17:00.599590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 265/513] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:00 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:01.054043 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:01.054600 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:01.060975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:01.061447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:01.061874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:01.062561 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:01.063035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:01.063558 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:01.192664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:01.200921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:01.202425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:01.203635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-89b6cea6-41dc-45aa-b4c0-9229259bff9d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.153563 Aug 18 17:17:01.204195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 249/514] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:01 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:01.365524 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:01.366123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:01.368097 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:01.368794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=8 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:01.373508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:01.374050 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:01.374474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:01.375181 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:01.375627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:01.376043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:01.507271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:01.515269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7c9986aa-805e-4320-a336-b2d4c96133a8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.153638 Aug 18 17:17:01.515910 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 266/515] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:01 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:17:01.620790 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:01.621325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:01.623705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=8 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:01.628443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:01.628951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:01.629379 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:01.630066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:01.630510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:01.630970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:01.767462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:01.775878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-68b558b5-25bd-44c9-8de4-57931211fcf5 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.159544 Aug 18 17:17:01.776438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 250/516] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:01 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:17:02.227318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:02.227940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:02.233842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:02.234315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:02.234749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:02.235470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:02.235924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:02.236445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:02.373365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:02.381751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:02.383282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:02.384957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ec5447ab-56cf-4f60-9a44-7e2d9df81781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.161690 Aug 18 17:17:02.385520 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 267/517] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:02 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:02.536898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:02.537536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:02.548115 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:02.548851 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:02.549316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:02.550013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:02.550462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:02.550879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:02.693036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:02.701049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b3f8b549-ab9d-46c6-879c-a9f01caddb0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.167957 Aug 18 17:17:02.701612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 251/518] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:02 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:02.797680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:02.798478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:02.804509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:02.804992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:02.805432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:02.806354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:02.806812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:02.807267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:02.939521 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:02.947495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5279d4ad-eeca-41a6-ad8f-9262d2ef8203 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.153557 Aug 18 17:17:02.948071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 268/519] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:02 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:03.408329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:03.408942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:03.414819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:03.416049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:03.416720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:03.417409 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:03.417861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:03.418280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:03.545333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:03.553692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:03.555242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:03.556401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dca966a6-976a-4eb5-9ccd-258beda4729a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.151992 Aug 18 17:17:03.556986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 252/520] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:03 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:03.721741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:03.722346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:03.728328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:03.728801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:03.729263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:03.729925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:03.730371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:03.730806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:03.860586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:03.868205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0be19731-5403-46ba-97bc-219aec88a724 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.150325 Aug 18 17:17:03.868838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 269/521] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:03 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:03.968829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:03.969377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:03.975945 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:03.976430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:03.976902 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:03.977602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:03.978110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:03.978538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:04.109323 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:04.116892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-de5ca606-3e3b-4b70-b742-4636d9b738ab tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.151907 Aug 18 17:17:04.117460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 253/522] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:03 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:04.579733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:04.580371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:04.586235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:04.586711 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:04.587246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:04.588079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:04.588531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:04.588956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:04.721054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:04.729819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:04.731343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:04.732497 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d0336da8-4d05-4c49-9eea-9482298a9ba9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.156660 Aug 18 17:17:04.733043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 270/523] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:04 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:04.887689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:04.888299 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:04.894113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:04.894591 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:04.895057 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:04.895743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:04.896187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:04.896603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:05.025440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:05.033289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-afa59847-54f2-49fc-acd4-c1221bea4789 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.149370 Aug 18 17:17:05.033867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 254/524] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:04 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:05.137851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:05.138429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:05.144355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:05.144862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:05.145290 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:05.145971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:05.146417 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:05.146840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:05.278413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:05.286121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ce812c1a-605f-4806-a4e9-41710973eb68 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.152977 Aug 18 17:17:05.286688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 271/525] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:05 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:05.754689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:05.755331 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:05.761451 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:05.761955 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:05.762387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:05.763108 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:05.763586 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:05.764005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:05.892445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:05.901415 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:05.902924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:05.904066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c26c519e-5e0e-473f-a571-62ece8182cee tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.153225 Aug 18 17:17:05.904615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 255/526] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:05 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:06.058125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:06.058732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:06.064814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:06.065295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:06.065721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:06.066402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:06.066848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:06.067294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:06.194419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:06.202381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-21db8a91-75b4-4f3c-88f6-23f8f6c8af5b tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.148726 Aug 18 17:17:06.202981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 272/527] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:06 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:06.307759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:06.308663 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:06.315042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:06.315523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:06.315983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:06.316679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:06.317136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:06.317587 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:06.450741 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:06.458807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-75d7c953-39bb-4240-846d-9c72e8678056 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.155692 Aug 18 17:17:06.459403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 256/528] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:06 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:17:06.927825 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:06.928424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:06.935195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:06.935667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:06.936097 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:06.936777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:06.937224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:06.937642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:07.067061 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:07.075305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:07.076803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:07.077946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6b3c014a-8d70-4cc3-8ca7-45e0bc8413e0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.154238 Aug 18 17:17:07.078508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 273/529] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:06 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:07.223371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:07.224013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:07.230622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:07.231217 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:07.231863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:07.232833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:07.233287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:07.233712 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:07.364894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:07.372547 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6a506ab5-79f7-4f93-a5f3-48066c8ecc27 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.153022 Aug 18 17:17:07.373105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 257/530] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:07 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:17:07.479939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:07.480548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:07.486469 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:07.486972 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:07.487408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:07.488090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:07.488540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:07.488963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:07.492972 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:07.628405 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:07.637208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d9e34b9e-53b9-415c-9df5-1bd9e31a1847 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.161605 Aug 18 17:17:07.637785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 274/531] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:07 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:08.100782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:08.101338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:08.107985 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:08.108457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:08.108885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:08.109625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:08.110064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:08.110479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:08.237058 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:08.246042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:08.247644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:08.248782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-31f7f9a3-20a4-4d18-9abe-ab479bfdf266 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.152080 Aug 18 17:17:08.249334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 258/532] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:08 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:08.393880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:08.394423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:08.400530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:08.401153 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:08.401636 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:08.402325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:08.402776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:08.403306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:08.535394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:08.543667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e1b543b5-ae7a-4b82-bf99-ccb1f3042bfc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.153745 Aug 18 17:17:08.544266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 275/533] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:08 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:08.658616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:08.659191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:08.665699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:08.666779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:08.667361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:08.668063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:08.668520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:08.668949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:08.798107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:08.802026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:08.806813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-df51d4b1-a874-4273-a54d-3f1dd1a7275a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.151939 Aug 18 17:17:08.807417 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 259/534] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:08 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:09.271523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:09.272060 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:09.278470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.279041 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.279477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.280191 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.280612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.281031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.413649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:09.423195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:09.425056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:09.426205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-60e8f87d-543e-445b-89ed-e351f72a5a71 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.158663 Aug 18 17:17:09.426815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 276/535] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:09 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:09.564843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:09.565573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:09.573357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.573872 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.574297 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.575034 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.575489 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.575911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.713589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:09.721160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b8726a7d-af59-4fab-9603-aa77c4a45750 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.160436 Aug 18 17:17:09.721732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 260/536] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:09 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:09.784763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-81d39cf8-7803-402d-9f88-960e7b07e6ae req-890688f4-a94e-4b8a-b565-a58c24572d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "name": "network-vif-plugged", "status": "completed", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:09.794235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-81d39cf8-7803-402d-9f88-960e7b07e6ae req-890688f4-a94e-4b8a-b565-a58c24572d82 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.794713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-81d39cf8-7803-402d-9f88-960e7b07e6ae req-890688f4-a94e-4b8a-b565-a58c24572d82 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.795171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-81d39cf8-7803-402d-9f88-960e7b07e6ae req-890688f4-a94e-4b8a-b565-a58c24572d82 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.806505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-81d39cf8-7803-402d-9f88-960e7b07e6ae req-890688f4-a94e-4b8a-b565-a58c24572d82 service nova] Creating event network-vif-plugged:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:17:09.811680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-81d39cf8-7803-402d-9f88-960e7b07e6ae req-890688f4-a94e-4b8a-b565-a58c24572d82 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030844 Aug 18 17:17:09.812272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 277/537] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:09.827878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:09.828489 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:09.834392 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.837703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.837703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.837703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:09.837703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:09.838661 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:09.976345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:09.984932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b83f37a1-639f-4607-947e-e851de1e1d94 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.160857 Aug 18 17:17:09.985516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 261/538] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:09 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:10.450600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:10.451353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:10.457758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:10.458272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:10.458680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:10.459788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:10.460258 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:10.460692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:10.591093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:10.599303 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:10.600812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:10.601968 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-196de0b3-f29c-4a7d-8cf6-96fc37e50fd0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.156149 Aug 18 17:17:10.602559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 278/539] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:10 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:10.741523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:10.742152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:10.748866 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:10.749339 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:10.749768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:10.750448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:10.750894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:10.751341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:10.879866 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:10.887690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9e279d65-ecec-4310-9565-9c96f0f3d2c1 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.150044 Aug 18 17:17:10.888262 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 262/540] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:10 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:11.010539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:11.010539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:11.012244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.012726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.013193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:11.013890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.014343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.014770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:11.149889 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:11.158367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2623bcc9-fcad-48b5-8d3f-204b74422587 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.156661 Aug 18 17:17:11.158953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 279/541] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:11 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:11.625820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:11.626432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:11.632372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.632826 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.633252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:11.637986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.637986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.637986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:11.766996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:11.778493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:11.780016 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:11.781206 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-aff19975-11e6-426e-aa29-3b6b6da536a8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.159503 Aug 18 17:17:11.781753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 263/542] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:11 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:17:11.826453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-1b9c294d-f216-43e5-a5ac-305c34bf92a5 req-ee5b8baf-6b32-4977-a03f-b1de5aa91973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d7dd09-76eb-4636-8841-e6ea99bc8041", "name": "network-vif-plugged", "status": "completed", "tag": "bd911500-528f-49b1-89cb-1ad9bb0f6a37"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:11.836209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-1b9c294d-f216-43e5-a5ac-305c34bf92a5 req-ee5b8baf-6b32-4977-a03f-b1de5aa91973 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.836719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-1b9c294d-f216-43e5-a5ac-305c34bf92a5 req-ee5b8baf-6b32-4977-a03f-b1de5aa91973 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.837159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-1b9c294d-f216-43e5-a5ac-305c34bf92a5 req-ee5b8baf-6b32-4977-a03f-b1de5aa91973 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:11.849928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-1b9c294d-f216-43e5-a5ac-305c34bf92a5 req-ee5b8baf-6b32-4977-a03f-b1de5aa91973 service nova] Creating event network-vif-plugged:bd911500-528f-49b1-89cb-1ad9bb0f6a37 for instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 on hv-cinder-85367 Aug 18 17:17:11.854683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-1b9c294d-f216-43e5-a5ac-305c34bf92a5 req-ee5b8baf-6b32-4977-a03f-b1de5aa91973 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032469 Aug 18 17:17:11.855336 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 280/543] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:11.907783 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:11.908402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:11.914205 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.914678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.915139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:11.915853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:11.916883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:11.917572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:12.049797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:12.058261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-248179bc-9c40-4f16-8b25-29f3a789ce41 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.154354 Aug 18 17:17:12.058827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 264/544] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:11 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:12.179458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:12.180079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:12.186858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:12.187373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:12.199928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:12.199928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:12.199928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:12.199928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:12.323305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:12.331354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9c113cb4-7b48-4460-a5f2-cf21981e3ff2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.156178 Aug 18 17:17:12.331911 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 281/545] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:12 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:12.804342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:12.805149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:12.811812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:12.812299 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:12.812740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:12.813563 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:12.814056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:12.819613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:12.945689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:12.954253 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:12.955764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:12.957130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-56f8c9cd-55d9-4702-adaa-202d77237a67 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.156492 Aug 18 17:17:12.957448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 265/546] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:12 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:13.078893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:13.079526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:13.085495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:13.085975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:13.093133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:13.093133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:13.093133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:13.093133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:13.220969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:13.228699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f7f0de2a-b6e6-4567-a483-936d0e5fa482 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.153656 Aug 18 17:17:13.229781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 282/547] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:13 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:13.352689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:13.353328 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:13.359414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:13.359894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:13.360331 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:13.361019 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:13.361472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:13.361895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:13.492752 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:13.501293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a83fd1e1-ba46-4491-a3f3-5234a7dd5474 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.152465 Aug 18 17:17:13.501925 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 266/548] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:13 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:13.980424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:13.981033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:13.987730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:13.988208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:13.988635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:13.989316 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:13.989760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:13.990172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:14.129281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:14.137588 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:14.139757 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:14.140918 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-05164cd5-40f0-4203-9f5e-4fa88cbe8fc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.164525 Aug 18 17:17:14.142437 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 283/549] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:13 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:14.250770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:14.251424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:14.268052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:14.268733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:14.269417 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:14.270079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:14.270538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:14.271119 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:14.471702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:14.479463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-75b474e1-7ffc-4750-b1a5-78601938029f tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.232647 Aug 18 17:17:14.480048 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 267/550] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:14 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:14.522414 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:14.523064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:14.529171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:14.530002 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:14.530446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:14.531165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:14.531613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:14.532033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:14.665559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:14.673988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-901b940f-24e8-41cc-919e-1a12641d4a74 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.155889 Aug 18 17:17:14.674545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 284/551] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:14 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:15.163549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:15.164153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:15.170240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:15.170793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:15.171252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:15.171941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:15.172384 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:15.172823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:15.312356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:15.320870 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:15.322543 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:15.323717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-676a8ced-caf9-4b67-aba1-e01bf2ca3573 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.164019 Aug 18 17:17:15.324274 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 268/552] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:15 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:15.500858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:15.501477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:15.507505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:15.507986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:15.508416 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:15.509106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:15.509557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:15.510157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:15.642580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:15.650310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0b51162f-be58-41cd-b587-7f9bf5e55315 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.153899 Aug 18 17:17:15.664698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 285/553] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:15 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:15.698059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:15.698834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:15.705397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:15.712397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:15.712868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:15.713595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:15.714172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:15.714790 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:15.856882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:15.866642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8f0f7e71-76a0-4045-81c8-386e2ea33e9f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.174211 Aug 18 17:17:15.867236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 269/554] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:15 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:16.348022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:16.348632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:16.354640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:16.355160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:16.355597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:16.356291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:16.356745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:16.357179 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:16.491134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:16.499673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:16.501156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:16.502302 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-10929d5f-fda8-455e-ac08-53b3d4ae29bc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.158240 Aug 18 17:17:16.502858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 286/555] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:16 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:16.674587 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:16.675551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:16.682002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:16.682481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:16.683127 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:16.684947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:16.684947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:16.684947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:16.836008 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:16.844345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3492dc10-0c85-4658-8f49-bd00549ffce8 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1319 microversion: 2.1 time: 0.173653 Aug 18 17:17:16.844924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 270/556] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:16 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:16.889859 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:16.890814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:16.897303 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:16.898038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:16.898474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:16.899230 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:16.899685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:16.900112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:17.041339 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:17.052985 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-89d12696-26cb-452a-aee7-5051fc1c9e63 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.168269 Aug 18 17:17:17.053559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 287/557] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:16 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:17.524652 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:17.525252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:17.531332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:17.531806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:17.535167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:17.535167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:17.535167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:17.535167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:17.663281 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:17.672539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:17.674063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:17.675497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-38f9fcbd-9432-47c8-af5c-9105c0deba88 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.154659 Aug 18 17:17:17.676065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 271/558] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:17 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:17.864797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:17.865406 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:17.871682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:17.872155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:17.872582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:17.873295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:17.873739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:17.874150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.007393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:18.015633 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bb699ab5-241e-4225-890f-3b76d0e28beb tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1508 microversion: 2.1 time: 0.154715 Aug 18 17:17:18.016191 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 288/559] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:17 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:18.036640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d8677e3-2fc3-478c-a3b6-6018dc71e157", "device": "/dev/sdb"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:18.039172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:18.041506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=86 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:18.046221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:18.050513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:18.050513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.050513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:18.050513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:18.050882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.073520 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:18.074183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:18.081369 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:18.081861 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:18.082303 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.083034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:18.083542 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:18.083906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.218828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:18.226428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b6a89abd-28ab-40d8-a0fb-f23d73b5b9b9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.156749 Aug 18 17:17:18.227010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 289/560] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:18 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:18.698097 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:18.698706 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:18.704972 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:18.705447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:18.705875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.706559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:18.707054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:18.707473 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:18.840277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:18.849773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:18.851304 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:18.852446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-acd10b8a-3d02-419d-870c-be0a58e3d458 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.158226 Aug 18 17:17:18.853022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 290/561] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:18 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:17:18.871640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-750e0ec4-0761-4ea6-93c4-cff4857b63d0 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "POST /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838756 Aug 18 17:17:18.877334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 272/562] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:17:18 2022] POST /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:19.164788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-ed106ab2-401d-4eaa-80eb-11a9876341e3 req-0fde9273-bbd3-4b81-8f6f-69f124b9ca0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1732a5ad-82ea-4429-ab40-0dd58302edd8", "name": "network-vif-plugged", "status": "completed", "tag": "0ec9e6c7-bd54-41cf-a346-2a13d678300a"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:19.176664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-ed106ab2-401d-4eaa-80eb-11a9876341e3 req-0fde9273-bbd3-4b81-8f6f-69f124b9ca0e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:19.177129 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-ed106ab2-401d-4eaa-80eb-11a9876341e3 req-0fde9273-bbd3-4b81-8f6f-69f124b9ca0e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:19.177609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-ed106ab2-401d-4eaa-80eb-11a9876341e3 req-0fde9273-bbd3-4b81-8f6f-69f124b9ca0e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:19.188949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-ed106ab2-401d-4eaa-80eb-11a9876341e3 req-0fde9273-bbd3-4b81-8f6f-69f124b9ca0e service nova] Creating event network-vif-plugged:0ec9e6c7-bd54-41cf-a346-2a13d678300a for instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 on hv-cinder-85367 Aug 18 17:17:19.193979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-ed106ab2-401d-4eaa-80eb-11a9876341e3 req-0fde9273-bbd3-4b81-8f6f-69f124b9ca0e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Aug 18 17:17:19.194577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 291/563] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:19.248716 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:19.254934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:19.262940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:19.263527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:19.265388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:19.266173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:19.266887 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:19.267439 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:19.413709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:19.421459 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-829b2c20-5d26-4047-8c4b-aca342539511 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.178008 Aug 18 17:17:19.422030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 273/564] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:19 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:19.877020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:19.877747 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:19.883928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:19.884405 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:19.884834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:19.885517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:19.885964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:19.886389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:20.022230 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:20.031115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:20.033038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:20.034513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:20.035684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a07f01cf-872e-4f2d-8150-7287ef3be5f2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.163758 Aug 18 17:17:20.036233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 292/565] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:19 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:20.442414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:20.443067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:20.449488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:20.450009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:20.450431 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:20.451160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:20.451613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:20.452046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:20.736955 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:20.744510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-53f228a8-a353-423d-9e2f-0ce8fb27b01b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.306022 Aug 18 17:17:20.745078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 274/566] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:20 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:21.059902 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:21.060512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:21.062509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:21.067189 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:21.067666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:21.068099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:21.068791 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:21.069242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:21.069666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:21.247259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:21.255517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:21.256952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:21.258095 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5e640991-40d7-4653-a375-121c4621eda9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.202446 Aug 18 17:17:21.258656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 293/567] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:21 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:21.765793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:21.767034 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:21.773509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:21.773987 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:21.774420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:21.775150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:21.775602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:21.776023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:21.780109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:21.912668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:21.921297 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5a3716e0-134b-4f0c-a47a-458d29039c76 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1266 microversion: 2.1 time: 0.159512 Aug 18 17:17:21.921970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 275/568] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:21 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:22.281939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:22.282579 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:22.304583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:22.304583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:22.304583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:22.304583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:22.304987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:22.304987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:22.425401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:22.433802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:22.435314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:22.437175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ff77c61b-fa97-4c3a-9ac2-c8cfe0d92d3b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1743 microversion: 2.20 time: 0.158875 Aug 18 17:17:22.437732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 294/569] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:22 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:22.942261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:22.942948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:22.949885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:22.950371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:22.950868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:22.951580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:22.952062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:22.952573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:23.087678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:23.097420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ec5f51f8-7942-4932-bcd3-8e907b62b0ba tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1452 microversion: 2.1 time: 0.158989 Aug 18 17:17:23.097994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 276/570] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:22 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:23.119204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:23.119548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:23.125945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:23.126428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:23.126857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:23.127702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:23.128319 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:23.128742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:23.260541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:23.268538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5ab0372a-8a9e-4baf-b394-b43b85e71e98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1452 microversion: 2.1 time: 0.153510 Aug 18 17:17:23.269105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 295/571] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:23 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:23.460828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:23.461483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:23.469908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:23.470398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:23.471040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:23.471954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:23.472564 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:23.473146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:23.685656 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:23.695529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:23.697020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:23.710392 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c7ee6222-ba8b-4473-9a52-a32dce45a57b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.253476 Aug 18 17:17:23.711477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 277/572] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:23 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:24.735929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:24.737360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:24.744082 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:24.745534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:24.746602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:24.749135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:24.749595 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:24.764833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:25.274078 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:25.278933 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:25.280630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:25.282007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b4912b15-dcaa-4bda-aed4-443d78e26c51 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.552255 Aug 18 17:17:25.299828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 296/573] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:24 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:26.064256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-953631d2-1367-48f7-adb8-f165b50c0857 req-fd1673f0-c4cb-493b-b77c-67d1ed776dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1732a5ad-82ea-4429-ab40-0dd58302edd8", "tag": "0ec9e6c7-bd54-41cf-a346-2a13d678300a"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:26.076285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-953631d2-1367-48f7-adb8-f165b50c0857 req-fd1673f0-c4cb-493b-b77c-67d1ed776dfd service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:26.077005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-953631d2-1367-48f7-adb8-f165b50c0857 req-fd1673f0-c4cb-493b-b77c-67d1ed776dfd service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:26.077776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-953631d2-1367-48f7-adb8-f165b50c0857 req-fd1673f0-c4cb-493b-b77c-67d1ed776dfd service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:26.090275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-953631d2-1367-48f7-adb8-f165b50c0857 req-fd1673f0-c4cb-493b-b77c-67d1ed776dfd service nova] Creating event network-changed:0ec9e6c7-bd54-41cf-a346-2a13d678300a for instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 on hv-cinder-85367 Aug 18 17:17:26.098250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-953631d2-1367-48f7-adb8-f165b50c0857 req-fd1673f0-c4cb-493b-b77c-67d1ed776dfd service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038039 Aug 18 17:17:26.099157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 278/574] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:26.305790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:26.308423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:26.319467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:26.319969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:26.320412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:26.321162 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:26.321624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:26.322060 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:26.491163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:26.493299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:26.494791 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:26.496006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-40a3ca28-2a63-4539-befd-17c7927e14f0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.194416 Aug 18 17:17:26.510925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 297/575] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:26 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:27.522069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:27.523785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:27.537731 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:27.539582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:27.544654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:27.544654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:27.544654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:27.545541 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:27.716995 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:27.726751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:27.728760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:27.730096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-52266120-9068-45a5-9dcb-3f949a294b7f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.213979 Aug 18 17:17:27.731166 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 279/576] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:27 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:28.753909 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:28.754527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:28.760838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:28.761449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:28.762143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:28.763122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:28.763799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:28.764507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:28.921464 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:28.932288 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:28.935424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:28.936607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0f7badc1-2792-462a-bb0a-b0b7b9fbec97 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.186755 Aug 18 17:17:28.937458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 298/577] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:28 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:29.959774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:29.960491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:29.967152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:29.967630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:29.968062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:29.969253 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:29.969698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:29.970124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:30.113222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:30.121272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:30.122768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:30.123954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ac8514e5-4a14-480a-b5e1-3b109d9e410d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.168099 Aug 18 17:17:30.124597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 280/578] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:29 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:31.281274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:31.282265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:31.292808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:31.293503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:31.294142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:31.295070 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:31.295713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:31.296130 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:31.452200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:31.466455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:31.468409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:31.470201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9d651903-5b83-4243-8475-3b897234d4dd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.326191 Aug 18 17:17:31.470935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 299/579] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:31 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:32.492843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:32.494100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:32.502605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:32.503825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:32.504451 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:32.505535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:32.506189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:32.507312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:32.674272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:32.691921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:32.693642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:32.694840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a6e72302-7c60-4f36-ba73-e6ea54ecc6eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.206247 Aug 18 17:17:32.695436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 281/580] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:32 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:33.719003 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:33.719528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:33.725610 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:33.726087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:33.726518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:33.727317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:33.730305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:33.730726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:33.876678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:33.887412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:33.889561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:33.893641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a0e9eef3-7b70-4e34-9aed-1310a2e3fd6e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.175775 Aug 18 17:17:33.893641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 300/581] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:33 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:34.918030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:34.918572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:34.924840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:34.925321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:34.925754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:34.926453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:34.927186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:34.927614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:35.072161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:35.081410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:35.082978 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:35.084139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3ddca42c-b43c-441c-9076-be2f08918028 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.170234 Aug 18 17:17:35.084700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 282/582] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:34 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:36.107837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:36.108601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:36.115154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:36.115629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:36.116086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:36.116764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:36.117209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:36.117627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:36.246848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:36.255684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:36.257294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:36.258430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a295d770-cbf4-49c3-90c0-d46b64c6232b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.154707 Aug 18 17:17:36.258995 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 301/583] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:36 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:37.281447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:37.282101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:37.288628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:37.289109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:37.289540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:37.290230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:37.290683 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:37.291129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:37.424974 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:37.433268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:37.434762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:37.435932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bf5718e8-5e97-4228-a73f-0201e0ecf35b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.158395 Aug 18 17:17:37.436488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 283/584] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:37 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:38.459215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:38.459814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:38.465697 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:38.466241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:38.466671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:38.467388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:38.467814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:38.468231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:38.596596 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:38.605239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:38.606749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:38.607924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a81235f0-88f8-4bfa-8425-d30a7e12841f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.152715 Aug 18 17:17:38.608482 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 302/585] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:38 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:17:39.632369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:39.632975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:39.643976 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:39.644460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:39.644989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:39.646065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:39.646716 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:39.647239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:39.800381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:39.808830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:39.810333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:39.811553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c1f92d0c-b458-4ada-9520-beabc03c6826 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.183530 Aug 18 17:17:39.812095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 284/586] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:39 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:40.836033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:40.836660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:40.842535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:40.843038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:40.843469 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:40.844147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:40.845430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:40.846030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:40.975586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:40.983719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:40.985216 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:40.986374 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-296966f2-02ed-4fc2-8b38-5d194118fede tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.154171 Aug 18 17:17:40.986952 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 303/587] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:40 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:42.008429 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:42.009235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:42.016149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:42.016625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:42.017059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:42.017746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:42.018246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:42.018613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:42.147168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:42.155142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:42.156623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:42.158452 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4f54a71c-6a00-47ea-ae18-1b41cd27c972 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1738 microversion: 2.20 time: 0.153262 Aug 18 17:17:42.158959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 285/588] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:42 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:43.180866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:43.181433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:43.187333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:43.187808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:43.188239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:43.188926 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:43.189590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:43.190013 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:43.317847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:43.325857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:43.327391 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:43.328569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2343dd97-5bcf-4dfa-a2ab-ded6de4d4940 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.151936 Aug 18 17:17:43.329118 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 304/589] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:43 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:44.352888 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:44.353494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:44.360005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:44.360479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:44.360907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:44.361985 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:44.362431 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:44.362850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:44.496574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:44.504925 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:44.506412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:44.507585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ebc6777b-0905-4c8e-ae03-2b7c2605deb5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.158713 Aug 18 17:17:44.508144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 286/590] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:44 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:45.529879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:45.530428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:45.536613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.537093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.537529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.538221 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.538674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.539131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.665759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:45.673715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:45.675582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:45.676714 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d65a30c0-a4eb-4659-90bd-30025ff94f21 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.150801 Aug 18 17:17:45.677266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 305/591] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:45 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:45.953924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-af2e79f6-e7df-4831-8546-746bea2af5f2 req-f6b4b0ec-6895-4d77-a870-97a0c931850b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "name": "network-vif-unplugged", "status": "completed", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:45.964100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-af2e79f6-e7df-4831-8546-746bea2af5f2 req-f6b4b0ec-6895-4d77-a870-97a0c931850b service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.969825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-af2e79f6-e7df-4831-8546-746bea2af5f2 req-f6b4b0ec-6895-4d77-a870-97a0c931850b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.969825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-af2e79f6-e7df-4831-8546-746bea2af5f2 req-f6b4b0ec-6895-4d77-a870-97a0c931850b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.975797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-af2e79f6-e7df-4831-8546-746bea2af5f2 req-f6b4b0ec-6895-4d77-a870-97a0c931850b service nova] Creating event network-vif-unplugged:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:17:45.980960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-af2e79f6-e7df-4831-8546-746bea2af5f2 req-f6b4b0ec-6895-4d77-a870-97a0c931850b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030770 Aug 18 17:17:45.981577 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 287/592] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:46.700271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:46.700876 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:46.707591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:46.708078 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:46.708508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:46.709198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:46.709647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:46.710067 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:46.837953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:46.845941 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:46.848091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:46.849225 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f2f91cad-c3d7-44f5-996a-9cecd6b0c892 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.152902 Aug 18 17:17:46.849779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 306/593] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:46 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:47.873191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:47.873850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:47.880144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:47.880621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:47.881053 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:47.881745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:47.882200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:47.882625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:48.011137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:48.022404 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:48.022404 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:48.022404 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3c5c147b-40fd-432f-85c7-a8fa50ae9ca6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.153473 Aug 18 17:17:48.022736 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 288/594] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:47 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:17:49.045511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:49.047790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:49.052736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:49.053211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:49.053948 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:49.054630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:49.055178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:49.055614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:49.192301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:49.200404 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:49.201920 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:49.203079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e052e1ea-35f8-41a0-aa86-922a6c10991e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.161487 Aug 18 17:17:49.203628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 307/595] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:49 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:50.226610 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:50.227379 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:50.229646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=34 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:50.234453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:50.234954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:50.235387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:50.236076 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:50.236529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:50.236946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:50.375371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:50.384817 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:50.390355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:50.390355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-61267baf-c743-4ff1-82e8-c8c02472a4e4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.165904 Aug 18 17:17:50.390355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 289/596] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:50 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:51.412890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:51.413503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:51.415460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=30 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:51.420064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:51.420568 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:51.421002 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:51.421695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:51.422139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:51.422558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:51.426780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=91 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:51.557616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:51.565494 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:51.567786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:51.568936 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-630cf5a2-cc48-4604-ba3e-6e8ecd1ab10e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1720 microversion: 2.20 time: 0.161209 Aug 18 17:17:51.569482 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 308/597] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:51 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:52.540538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:52.541077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:52.547729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:52.551447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:52.551447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:52.551447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:52.551447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:52.552041 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:52.553552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=81 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:52.592868 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:52.593479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:52.600492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:52.601196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:52.601621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:52.602441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:52.602890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:52.608852 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:52.683782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lazy-loading 'services' on Instance uuid 60d7dd09-76eb-4636-8841-e6ea99bc8041 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:17:52.761510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:52.771010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:52.772480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:52.773641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ff098d0c-6936-445b-b15f-477824d233b8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1723 microversion: 2.20 time: 0.184716 Aug 18 17:17:52.774197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 309/598] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:52 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:17:52.797428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c05c8dd-af07-4c12-a1c8-3bf4f212ef3a"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:52.799855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:52.806114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:52.807805 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:52.807805 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:52.807805 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:52.808182 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:52.808649 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:53.025629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8b504eb2-9fca-427f-8e6d-7a1e45019cf3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041/os-volume_attachments/2d8677e3-2fc3-478c-a3b6-6018dc71e157" status: 202 len: 0 microversion: 2.1 time: 0.488965 Aug 18 17:17:53.026568 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 290/599] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:17:52 2022] DELETE /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041/os-volume_attachments/2d8677e3-2fc3-478c-a3b6-6018dc71e157 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:17:53.907472 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6b6cf7b1-c9b6-4c4f-b82b-3b8d2680bd3c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.113854 Aug 18 17:17:53.908089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 310/600] 10.222.0.82 () {62 vars in 1364 bytes} [Thu Aug 18 17:17:52 2022] POST /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments => generated 188 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:17:54.158703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:54.159632 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:54.170009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:54.170485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:54.170941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:54.171627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:54.172073 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:54.172490 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:54.264853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121217) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 17:17:54.553223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a28918ab-ab55-479e-8f0a-b0b9b3ffd334 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/action" status: 202 len: 0 microversion: 2.20 time: 0.399110 Aug 18 17:17:54.554653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 291/601] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 17:17:54 2022] POST /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:17:54.562349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:54.562991 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:54.569603 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:54.570083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:54.570508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:54.571239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:54.571688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:54.572110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:54.706213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:54.715788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:54.717355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:54.718508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6cf7df05-4fb7-4800-b6f7-e5cf796001d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1749 microversion: 2.20 time: 0.160051 Aug 18 17:17:54.719364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 311/602] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:54 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:55.258219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:55.259215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:55.265625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:55.266110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:55.266542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:55.267265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:55.267717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:55.268179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:55.294587 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:17:55.536940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d945f700-0506-4ce4-bbdc-249cc788e1cc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "DELETE /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 204 len: 0 microversion: 2.1 time: 0.282944 Aug 18 17:17:55.537609 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 292/603] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:17:55 2022] DELETE /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:17:55.547026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:55.547026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:55.552477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:55.552958 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:55.553390 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:55.554346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:55.554772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:55.555218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:55.694609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:55.702422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-da8d259d-f5fe-40be-8620-ed2afb12c9a3 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1514 microversion: 2.1 time: 0.160401 Aug 18 17:17:55.703175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 312/604] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:55 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:55.741876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:55.742567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:55.748506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:55.748987 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:55.749420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:55.750104 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:55.750555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:55.751001 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:55.916273 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:55.926181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:55.927804 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:55.929776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4c922376-ecd5-4d10-88cc-6b38f47afd36 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1749 microversion: 2.20 time: 0.191569 Aug 18 17:17:55.931549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 293/605] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:55 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1749 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:56.725844 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:56.726622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:56.732956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:56.733432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:56.733860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:56.734554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:56.735029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:56.735448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:56.869631 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:56.877723 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ff010897-2453-4d50-ae75-97377d797a0d tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1514 microversion: 2.1 time: 0.157052 Aug 18 17:17:56.884451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 313/606] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:56 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:56.955411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:56.956020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:56.962858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:56.963367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:56.963892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:56.964700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:56.965136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:56.965731 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:57.106378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:57.116247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:57.117780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:57.118989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-14381e3e-a4d4-42ee-b0ac-f44de8357afe tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1749 microversion: 2.20 time: 0.167585 Aug 18 17:17:57.120373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 294/607] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:56 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:57.898738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:57.899378 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:57.905364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:57.909443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:57.909443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:57.909443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:57.909443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:57.909949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:58.023654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f58f87972d46be9496e6216f1f5ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '420292ae9c0547cc9755f24c23d419c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:58.032992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a5c21571-9193-445c-ab4d-6c15cbb5ef69 tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 200 len: 1472 microversion: 2.1 time: 0.137995 Aug 18 17:17:58.033996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 314/608] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:57 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 1472 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:58.037672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-dfb34a39-1d33-4135-821a-5cb7ad05a4de req-40e7ef78-df27-4550-95d6-39833938b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d7dd09-76eb-4636-8841-e6ea99bc8041", "name": "network-vif-deleted", "tag": "bd911500-528f-49b1-89cb-1ad9bb0f6a37"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:58.049479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-dfb34a39-1d33-4135-821a-5cb7ad05a4de req-40e7ef78-df27-4550-95d6-39833938b0d8 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:58.050021 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-dfb34a39-1d33-4135-821a-5cb7ad05a4de req-40e7ef78-df27-4550-95d6-39833938b0d8 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:58.051091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-dfb34a39-1d33-4135-821a-5cb7ad05a4de req-40e7ef78-df27-4550-95d6-39833938b0d8 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:58.062774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-dfb34a39-1d33-4135-821a-5cb7ad05a4de req-40e7ef78-df27-4550-95d6-39833938b0d8 service nova] Creating event network-vif-deleted:bd911500-528f-49b1-89cb-1ad9bb0f6a37 for instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 on hv-cinder-85367 Aug 18 17:17:58.068498 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-dfb34a39-1d33-4135-821a-5cb7ad05a4de req-40e7ef78-df27-4550-95d6-39833938b0d8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Aug 18 17:17:58.069116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 295/609] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:58.147535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:58.154305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:58.154783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:58.155354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:58.155849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:58.156549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:58.157023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:58.157417 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:58.303275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:58.313193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:58.323150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:58.323150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b0063873-beb3-408f-b2ae-c2d2c4e82f66 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1751 microversion: 2.20 time: 0.176233 Aug 18 17:17:58.323150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 315/610] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:58 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:17:59.056438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:59.057170 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] [instance: 60d7dd09-76eb-4636-8841-e6ea99bc8041] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:59.064119 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:59.064598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:59.065035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:59.065771 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:59.066789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:59.067196 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:59.086315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] HTTP exception thrown: Instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 could not be found. Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Request method failure captured: Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 HTTP/1.1 Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nN3ukIe8-wTTw-PjMzkoj0S3nEFycw0fX-smVDSjd9-Ta1IhE0qkBkjji3xiFZj1bVJCKXQp7zsp0VsxOPfgOaQXdGVvXayLOqiG6augfoEmZsgCGGfYWylTZ8o1jE_pGF54GqICAMhW2T0x6xi5X84lv7vNNAAHbaR0nqQODRSelI Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 420292ae9c0547cc9755f24c23d419c3 Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1461234341 Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:17:59.088252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/420292ae9c0547cc9755f24c23d419c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-VolumesSnapshotTestJSON-1461234341 Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 420292ae9c0547cc9755f24c23d419c3 Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1461234341 Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-VolumesSnapshotTestJSON-1461234341-project Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 32f58f87972d46be9496e6216f1f5ca1 Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-VolumesSnapshotTestJSON-1461234341-project Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 could not be found. Aug 18 17:17:59.089920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '60d7dd09-76eb-4636-8841-e6ea99bc8041'} Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 could not be found. Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:17:59.091070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 could not be found. Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 could not be found. Aug 18 17:17:59.092690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:17:59.094347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] Returning 404 to user: Instance 60d7dd09-76eb-4636-8841-e6ea99bc8041 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:17:59.094347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-355e5a3c-9ff1-422d-9363-f36d9b3466fc tempest-VolumesSnapshotTestJSON-1461234341 tempest-VolumesSnapshotTestJSON-1461234341-project] 10.222.0.82 "GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041" status: 404 len: 111 microversion: 2.1 time: 0.039072 Aug 18 17:17:59.094347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 296/611] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:59 2022] GET /compute/v2.1/servers/60d7dd09-76eb-4636-8841-e6ea99bc8041 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:17:59.345765 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:59.348800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:59.352587 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:59.353089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:59.353530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:59.354208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:59.354656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:59.355101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:59.811048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:59.820469 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:59.822555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:59.824333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e933ae78-9f17-4590-bdbf-613e2204c77d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.482128 Aug 18 17:17:59.825573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 316/612] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:17:59 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:00.849601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:00.850206 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:00.856948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:00.857779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:00.858443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:00.859413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:00.860077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:00.860724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:01.024191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:01.035728 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:01.037915 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:01.039491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8977f312-83d6-4bb4-9a6b-61c8ecdd3607 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.195081 Aug 18 17:18:01.040796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 297/613] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:00 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:02.066210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:02.068274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:02.079663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:02.080163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:02.080780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:02.081493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:02.082880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:02.083412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:02.242627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:02.252616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:02.254797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:02.256147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-85ce7405-e770-46ea-b51d-288a9a2ab506 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.196090 Aug 18 17:18:02.256713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 317/614] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:02 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:03.279815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:03.280412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:03.287998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:03.288418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:03.288846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:03.289739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:03.290188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:03.290611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:03.435900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:03.445960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:03.447889 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:03.449655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7f4c1fcc-f5cb-4e47-b4b5-780eca97fcb6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.173363 Aug 18 17:18:03.450449 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 298/615] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:03 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:04.476092 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:04.477589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:04.486218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:04.487001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:04.487652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:04.489258 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:04.489977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:04.491010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:04.662640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:04.675402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:04.678356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:04.680001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-14c75bf6-4dd1-4ef7-8243-0060cb252a94 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.209427 Aug 18 17:18:04.680635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 318/616] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:04 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:05.703182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:05.703799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:05.712235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:05.717385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:05.717385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:05.717385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:05.717385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:05.717779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:05.866100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:05.878731 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:05.887443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:05.888988 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ee4b5754-fd94-4333-a0d6-4ecbebfc743f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.189893 Aug 18 17:18:05.890130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 299/617] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:05 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:06.916855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:06.917452 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:06.923359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:06.923839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:06.924270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:06.924959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:06.925412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:06.925831 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:07.056587 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:07.065599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:07.067153 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:07.068334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1654e96a-8484-4f57-b47c-58b87210cf2a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.155800 Aug 18 17:18:07.068895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 319/618] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:06 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:18:08.091552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:08.092174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:08.098651 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:08.099908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:08.100345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:08.101042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:08.101496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:08.101924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:08.236107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:08.245457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:08.246982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:08.248126 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-94dc3652-27bf-4507-8d9b-cd9bfc3786ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.160521 Aug 18 17:18:08.248683 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 300/619] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:08 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:09.271470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:09.272081 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:09.279020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:09.279614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:09.280143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:09.280936 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:09.281482 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:09.282013 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:09.421253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:09.432366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:09.433943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:09.435155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ffd93e79-15da-4035-a790-16adfb2cbaa7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.167563 Aug 18 17:18:09.435906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 320/620] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:09 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:10.459907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:10.460780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:10.471477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:10.471966 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:10.472398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:10.473192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:10.473642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:10.474062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:10.635792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:10.645644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:10.647426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:10.648579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0e7b77f8-9d46-4cc6-b46c-fe873695f25d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.192742 Aug 18 17:18:10.650175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 301/621] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:10 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:11.673308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:11.673891 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:11.679785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:11.680263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:11.681128 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:11.681760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:11.682210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:11.682631 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:11.812848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:11.821913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:11.823436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:11.824585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3c22cb49-0354-4974-96a7-2f4ff87cf771 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.155348 Aug 18 17:18:11.825139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 321/622] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:11 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:12.847951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:12.848556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:12.855998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:12.856469 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:12.856897 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:12.857573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:12.858018 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:12.858432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:12.989540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:12.998605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:13.000157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:13.001309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d6723865-f57b-4287-a36b-28efe450398b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.157225 Aug 18 17:18:13.001864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 302/623] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:12 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:14.023057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:14.023668 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:14.029664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:14.030145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:14.030589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:14.031310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:14.031763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:14.032186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:14.036023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:14.163001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:14.172334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:14.173838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:14.175022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-94ce63ac-4020-4850-bcf5-b58ab1777540 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.155845 Aug 18 17:18:14.175582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 322/624] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:14 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:15.201042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:15.201678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:15.208023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:15.208495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:15.208924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:15.209603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:15.210049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:15.210466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:15.338020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:15.346812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:15.348342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:15.349490 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-463f197a-f0d5-4619-b542-482137e0cb8e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.153255 Aug 18 17:18:15.350048 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 303/625] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:15 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:16.377648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:16.378278 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:16.384308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:16.384783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:16.385208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:16.385964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:16.386407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:16.386829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:16.520811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:16.530396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:16.532700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:16.533103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ef54f9ff-6fde-45f6-bffc-3742e5e75df0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.164017 Aug 18 17:18:16.533657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 323/626] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:16 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:17.556313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:17.556901 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:17.563904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:17.564379 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:17.564806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:17.565507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:17.565949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:17.566365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:17.696574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:17.698960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:17.706087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:17.707626 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:17.708800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-efee8882-fb61-483e-a19a-b7d8e53624df tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.156583 Aug 18 17:18:17.709660 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 304/627] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:17 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:18.732251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:18.732875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:18.738849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:18.739355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:18.739783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:18.740498 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:18.740945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:18.741386 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:18.871422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:18.880107 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:18.881601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:18.882754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e4db1858-8e35-4dc6-ae86-e4e217391f00 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.155195 Aug 18 17:18:18.883373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 324/628] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:18 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:19.906123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:19.906766 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:19.914042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:19.914522 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:19.914981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:19.915679 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:19.916134 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:19.916562 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:20.047237 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:20.055801 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:20.057556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:20.058690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ae36e662-d27c-4167-9ecc-1a7a304b42f7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.157152 Aug 18 17:18:20.059286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 305/629] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:19 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:21.081853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:21.082460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:21.088411 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:21.088886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:21.089322 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:21.090010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:21.090456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:21.090959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:21.219096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:21.227951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:21.232894 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:21.232894 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-333036f1-5117-4359-b8e0-1352f5fb288b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.152687 Aug 18 17:18:21.232894 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 325/630] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:21 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:22.254313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:22.254831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:22.257231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:22.261881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:22.262362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:22.263313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:22.267669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:22.267669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:22.267669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:22.397438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:22.407074 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:22.408575 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:22.409753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c0c7bf43-c823-4465-9202-9020202453c2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.159464 Aug 18 17:18:22.410313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 306/631] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:22 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:23.432965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:23.433564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:23.435522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=36 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:23.440252 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:23.445858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:23.445858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:23.445858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:23.445858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:23.446214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:23.570882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:23.580259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:23.581744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:23.582880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bbf79275-141b-4123-937e-3638586f54ed tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.154051 Aug 18 17:18:23.583446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 326/632] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:23 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:24.608002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:24.608646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:24.615060 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:24.615537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:24.615961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:24.616640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:24.617082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:24.617500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:24.752028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:24.760458 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:24.761943 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:24.763678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9920cc7a-172d-4230-ade1-4a6c945fff63 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.159779 Aug 18 17:18:24.764337 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 307/633] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:24 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:25.786054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:25.786693 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:25.792696 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:25.793173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:25.793602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:25.794377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:25.794872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:25.795327 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:25.923654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:25.932324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:25.933801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:25.934977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dc2872ae-f626-42e1-a988-82daa500b9a2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.152735 Aug 18 17:18:25.935813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 327/634] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:25 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:26.957422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:26.958057 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:26.964374 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:26.964856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:26.965292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:26.965981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:26.967074 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:26.967505 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:27.095467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:27.103938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:27.105422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:27.106556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-eb905768-d45c-4589-a81e-cf151743978b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.152936 Aug 18 17:18:27.107711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 308/635] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:26 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:28.129638 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:28.130221 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:28.136292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:28.136687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:28.137086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:28.137768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:28.138331 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:28.138786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:28.271627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:28.280514 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:28.282009 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:28.283202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-13a662fc-64e8-440c-9ffb-a137ebda0910 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.157393 Aug 18 17:18:28.283755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 328/636] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:28 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:29.307725 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:29.308392 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:29.315260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:29.315745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:29.316185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:29.316879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:29.317335 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:29.317760 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:29.444873 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:29.453771 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:29.455301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:29.456453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d088a727-7f4b-47ac-899b-4e97d27d4dcd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.152979 Aug 18 17:18:29.457016 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 309/637] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:29 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:30.480656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:30.480656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:30.486785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:30.487280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:30.487707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:30.488393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:30.488840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:30.489253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:30.628848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:30.637326 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:30.638860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:30.640374 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-34b63451-10d7-448f-8d46-fb7435901ee6 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.164904 Aug 18 17:18:30.640928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 329/638] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:30 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:31.663634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:31.664233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:31.671129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:31.671702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:31.672140 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:31.672822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:31.673270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:31.673685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:31.802597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:31.812215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:31.813717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:31.814863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8914569d-d9d8-433e-bb01-255053b21c32 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.155131 Aug 18 17:18:31.815439 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 310/639] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:31 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:32.365564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-e70d82aa-0f44-40af-a53a-b5815f45b4c7 req-a6fe8e12-e2cf-458f-b4f1-0b8efb58b82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "name": "network-vif-plugged", "status": "completed", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:18:32.375192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e70d82aa-0f44-40af-a53a-b5815f45b4c7 req-a6fe8e12-e2cf-458f-b4f1-0b8efb58b82f service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:32.375666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e70d82aa-0f44-40af-a53a-b5815f45b4c7 req-a6fe8e12-e2cf-458f-b4f1-0b8efb58b82f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:32.376090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e70d82aa-0f44-40af-a53a-b5815f45b4c7 req-a6fe8e12-e2cf-458f-b4f1-0b8efb58b82f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:32.465114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-e70d82aa-0f44-40af-a53a-b5815f45b4c7 req-a6fe8e12-e2cf-458f-b4f1-0b8efb58b82f service nova] Creating event network-vif-plugged:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:18:32.471721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-e70d82aa-0f44-40af-a53a-b5815f45b4c7 req-a6fe8e12-e2cf-458f-b4f1-0b8efb58b82f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171566 Aug 18 17:18:32.472379 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 330/640] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:18:32.837607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:32.838373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:32.845885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:32.846371 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:32.846803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:32.847525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:32.847978 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:32.848403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:32.981539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:32.991017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:32.992732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:32.993885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-021fdb4e-afed-4edc-af79-3ec8fcfb61de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.160386 Aug 18 17:18:32.997320 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 311/641] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:32 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:34.019050 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:34.019845 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:34.025873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:34.026353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:34.026779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:34.027493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:34.027937 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:34.028354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:34.163715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:34.172544 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:34.174038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:34.175272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e75df7e3-9af1-44bf-b288-d8c2b61d8aa9 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.161434 Aug 18 17:18:34.175835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 331/642] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:34 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:35.199096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:35.199634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:35.206140 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:35.206624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:35.207101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:35.207798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:35.208282 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:35.208709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:35.340552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:35.350017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:35.351553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:35.352711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-17cbb445-dbb7-4270-9395-106f6bfa6340 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.157735 Aug 18 17:18:35.353270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 312/643] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:35 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:36.376742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:36.377391 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:36.383196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:36.383665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:36.384088 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:36.384768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:36.385212 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:36.385630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:36.523034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:36.532484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:36.533913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:36.535314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-781d3a25-8343-474f-93e4-c520e9b954fc tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1807 microversion: 2.20 time: 0.163075 Aug 18 17:18:36.535878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 332/644] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:36 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:37.560497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:18:37.561204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:37.567900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:37.572655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:37.572655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:37.572655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:37.572655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:37.573109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:37.743551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:37.752651 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:37.754625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:18:37.755869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c6127470-f413-4bd3-9a33-331f5d77711f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1794 microversion: 2.20 time: 0.199759 Aug 18 17:18:37.756468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 313/645] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:18:37 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:18:41.552573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:18:41.553271 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:18:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:18:53.273878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=13 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:53.277791 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=61 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:53.493356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "818cd3c2-22d1-4165-8912-0f3dc5dcef64"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:18:53.495748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:18:53.501598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:53.502069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:53.502500 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:53.503206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:18:53.503655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:18:53.504073 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:18:55.137646 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f4517b9d-2c4a-4ece-bcde-fd4be240210b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.868328 Aug 18 17:18:55.138305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 333/646] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:18:53 2022] POST /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments => generated 194 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:03.721095 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:03.723341 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:03.725583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=15 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:03.726331 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=55 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:03.733815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:03.734297 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:03.734735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:03.735462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:03.735921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:03.736350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:03.759315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'flavor' on Instance uuid d082780b-e2a5-480f-9edf-5793b00ce795 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:19:04.115048 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9ec6e6ef-0a2c-4e26-99c3-f9aa5481d00a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/action" status: 200 len: 32 microversion: 2.1 time: 0.397748 Aug 18 17:19:04.116247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 314/647] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:19:03 2022] POST /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:19:04.126384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:04.127324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:04.129851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:04.135573 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:04.136051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:04.136483 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:04.137211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:04.137661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:04.138084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:04.300504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:04.310033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cf185184-3fc5-4cb8-93b7-0b4af6f394ae tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.187738 Aug 18 17:19:04.310616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 334/648] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:04 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:05.331800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:05.332534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:05.339669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:05.342042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:05.342042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:05.342042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:05.342042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:05.342434 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:05.473727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:05.481800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1e47a5d0-6d82-4158-8ebe-b18dd3725fa5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.154824 Aug 18 17:19:05.482360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 315/649] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:05 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:06.502541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:06.503104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:06.509462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:06.509939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:06.510476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:06.511127 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:06.511580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:06.512003 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:06.641892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:06.650197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-18cb3467-b463-4d03-8ff8-a35067e0b0d3 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.151584 Aug 18 17:19:06.650845 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 335/650] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:06 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:07.671789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:07.672405 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:07.679408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:07.683329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:07.683329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:07.683329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:07.683329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:07.683767 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:07.810944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:07.819681 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f5a948f1-6854-4dc7-a8f7-25a7ab5f108c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.151073 Aug 18 17:19:07.824707 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 316/651] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:07 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:08.841317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:08.841924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:08.848266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:08.848662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:08.849094 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:08.849770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:08.850244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:08.850964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:08.988663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:08.997789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-64aad100-b179-459c-85fe-6c32c08d89e4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.160316 Aug 18 17:19:08.998347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 336/652] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:08 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:10.019719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:10.020345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:10.027258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:10.027733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:10.028167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:10.028851 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:10.029302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:10.029723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:10.159532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:10.168624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-500d7299-496e-4dd8-87fc-9da58be8e808 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.152658 Aug 18 17:19:10.169105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 317/653] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:10 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:19:11.189935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:11.190536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:11.196983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:11.197482 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:11.197897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:11.198582 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:11.199058 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:11.199487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:11.328789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:11.338030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4389262d-a5f0-4094-bc5c-eb65687cc71e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.151881 Aug 18 17:19:11.338640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 337/654] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:11 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:12.359893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:12.360500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:12.367057 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:12.367534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:12.367967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:12.368651 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:12.369099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:12.369518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:12.495823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:12.503934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6f2e0550-4224-4675-9a58-e0ffc41dc961 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.147939 Aug 18 17:19:12.504497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 318/655] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:12 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:13.525661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:13.526299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:13.532680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:13.533197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:13.533637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:13.534332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:13.534790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:13.535242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:13.662730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:13.671531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0b94bdb0-6623-42c1-9bc0-8060eea54e3d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.149884 Aug 18 17:19:13.672641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 338/656] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:13 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:14.692933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:14.693525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:14.700727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:14.701203 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:14.701638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:14.702321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:14.702769 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:14.703229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:14.837537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:14.845940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e50122de-4f68-4ead-9c8b-27e688ca6b95 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.156802 Aug 18 17:19:14.846504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 319/657] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:14 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:15.867511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:15.868116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:15.875005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:15.875478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:15.875906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:15.876591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:15.877036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:15.877461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:16.002888 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:16.011357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b57e02c1-4f62-4bb9-bfbc-b2820a946fe8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.147998 Aug 18 17:19:16.011916 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 339/658] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:15 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:17.033266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:17.033822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:17.040938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:17.041419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:17.041856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:17.042556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:17.043061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:17.043489 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:17.174660 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:17.183477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-13d8ceb3-b249-4bd7-9ec6-d45b206447a0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.154113 Aug 18 17:19:17.184035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 320/659] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:17 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:18.204798 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:18.205400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:18.212152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:18.212629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:18.213059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:18.213736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:18.214181 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:18.214601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:18.341509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:18.349720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7c7aefa7-d84e-4aff-887e-42040b257216 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.148758 Aug 18 17:19:18.350279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 340/660] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:18 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:19.371163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:19.371702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:19.378042 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:19.378515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:19.378982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:19.379673 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:19.380252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:19.380677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:19.512131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:19.520364 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e8b59943-7d03-4563-b372-d0e5775108b4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.153239 Aug 18 17:19:19.520922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 321/661] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:19 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:20.542814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:20.543447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:20.550075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:20.550551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:20.551007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:20.551686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:20.552131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:20.552548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:20.680549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:20.688843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a1f54d01-2ced-4ab9-bb72-1f4357dbf650 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.150585 Aug 18 17:19:20.689401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 341/662] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:20 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:21.709867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:21.710474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:21.717136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:21.717620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:21.718058 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:21.718750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:21.719234 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:21.719665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:21.847422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:21.856227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fa195c27-793e-4d0f-bd37-c079d3de633e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.150495 Aug 18 17:19:21.856785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 322/663] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:21 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:22.877530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:22.878141 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:22.885367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:22.885845 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:22.886280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:22.886987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:22.887442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:22.887866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:23.013673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:23.021835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ecd41273-663c-4121-a851-539794ec34d8 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1736 microversion: 2.1 time: 0.148127 Aug 18 17:19:23.022343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 342/664] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:22 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:24.042951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:24.043569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:24.050101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.050581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.051045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.051734 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.052187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.052701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.411135 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:24.419483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-46aad686-1473-4a71-a132-9c0d8ef9649a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1716 microversion: 2.1 time: 0.380570 Aug 18 17:19:24.420038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 323/665] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:24 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1716 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:24.529803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:24.530301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:24.536396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.536875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.537312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.537999 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.538454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.539453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.543325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:24.620169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] HTTP exception thrown: Cannot 'detach_volume' instance d082780b-e2a5-480f-9edf-5793b00ce795 while it is in vm_state rescued Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Request method failure captured: Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments/818cd3c2-22d1-4165-8912-0f3dc5dcef64 HTTP/1.1 Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nMBn6eQh4g6Ef-NDef2IXjmOxcIYI3WcPprGjEubTNTP544Ce_YGDSQbTI-KX9h5KLLurAQ8LYiP0SZ5Fu7D_E3bKe78ANfioYKnRjWXFwcupQvS9ZQDVOYsDpFa5rCMzANCP2fMFZJEw6Zkt0qjHTElMZ1rhcr8QJt9L7iLkwE8Ck Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:19:24.621771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/289886000851431da2e3aebc3b47be8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: ecdea0572cc64ca394cd4d977f536d5a Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:19:24.623242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Cannot 'detach_volume' instance d082780b-e2a5-480f-9edf-5793b00ce795 while it is in vm_state rescued Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'server_id': 'd082780b-e2a5-480f-9edf-5793b00ce795', 'id': '818cd3c2-22d1-4165-8912-0f3dc5dcef64'} Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d082780b-e2a5-480f-9edf-5793b00ce795 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:19:24.623919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d082780b-e2a5-480f-9edf-5793b00ce795 while it is in vm_state rescued Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d082780b-e2a5-480f-9edf-5793b00ce795 while it is in vm_state rescued Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:19:24.625155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Returning 409 to user: Cannot 'detach_volume' instance d082780b-e2a5-480f-9edf-5793b00ce795 while it is in vm_state rescued {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:19:24.626204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-77a9eae1-5a84-41cb-a757-a38721c4e25b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments/818cd3c2-22d1-4165-8912-0f3dc5dcef64" status: 409 len: 152 microversion: 2.1 time: 0.097502 Aug 18 17:19:24.626204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 343/666] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:19:24 2022] DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments/818cd3c2-22d1-4165-8912-0f3dc5dcef64 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 17:19:24.632153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:24.632747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:24.638521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.639039 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.639607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.640288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.640746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.641173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.871830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-27c11f60-beb7-4b0d-84a2-69c73857e8ed tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "POST /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/action" status: 202 len: 0 microversion: 2.1 time: 0.243233 Aug 18 17:19:24.872648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 324/667] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:19:24 2022] POST /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:19:24.881725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:24.883692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:24.888808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.889291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.889715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:24.890396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:24.890836 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:24.891274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:25.062758 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:25.071776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-56dbee67-78f0-44ba-b951-db4a1cba86bf tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1724 microversion: 2.1 time: 0.194216 Aug 18 17:19:25.072334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 344/668] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:24 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:26.092883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:26.093579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:26.100099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.100574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.101003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.102230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.102674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.103122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.234823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:26.244077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a22ab62b-aa2a-4cbe-bb05-988e56b264ac tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1724 microversion: 2.1 time: 0.155383 Aug 18 17:19:26.244661 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 325/669] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:26 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:27.264787 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:27.265415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:27.271924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:27.272402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:27.272834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:27.273584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:27.274057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:27.274478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:27.402471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:27.411320 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f997b14d-b069-42f0-91b5-f6ff63e996d7 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1724 microversion: 2.1 time: 0.150379 Aug 18 17:19:27.411878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 345/670] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:27 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:28.432577 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:28.433181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:28.439378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:28.439851 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:28.440304 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:28.440988 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:28.441465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:28.441884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:28.572940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:28.582106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-90383756-3186-4de0-b960-933389430e24 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1724 microversion: 2.1 time: 0.153556 Aug 18 17:19:28.582677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 326/671] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:28 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:29.603705 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:29.604495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:29.610852 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:29.611356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:29.611788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:29.612471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:29.612924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:29.613345 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:29.742532 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:29.751323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1bcc1c76-96d1-43c9-b13c-5472f9609250 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1730 microversion: 2.1 time: 0.151421 Aug 18 17:19:29.752032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 346/672] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:29 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:29.771553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:29.780028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:29.780028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:29.780028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:29.780028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:29.780501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:29.780501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:29.780848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:29.798333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:29.859176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2c511eed-bdc4-42e4-a4c2-7da717acb3a1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091341 Aug 18 17:19:29.859800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 327/673] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:19:29 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:31.087214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-e5354140-feb4-4d72-b9e6-7165f6a738ca req-9959929e-0e85-4b0b-aa04-d3cd56f2d980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d082780b-e2a5-480f-9edf-5793b00ce795", "tag": "384961f9-0f01-4d12-864e-a14aa382c228"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:31.097380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e5354140-feb4-4d72-b9e6-7165f6a738ca req-9959929e-0e85-4b0b-aa04-d3cd56f2d980 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:31.097853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e5354140-feb4-4d72-b9e6-7165f6a738ca req-9959929e-0e85-4b0b-aa04-d3cd56f2d980 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:31.098286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e5354140-feb4-4d72-b9e6-7165f6a738ca req-9959929e-0e85-4b0b-aa04-d3cd56f2d980 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:31.109561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-e5354140-feb4-4d72-b9e6-7165f6a738ca req-9959929e-0e85-4b0b-aa04-d3cd56f2d980 service nova] Creating event network-changed:384961f9-0f01-4d12-864e-a14aa382c228 for instance d082780b-e2a5-480f-9edf-5793b00ce795 on hv-cinder-85367 Aug 18 17:19:31.114613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-e5354140-feb4-4d72-b9e6-7165f6a738ca req-9959929e-0e85-4b0b-aa04-d3cd56f2d980 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152630 Aug 18 17:19:31.115245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 347/674] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:33.130537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-e788b1c1-9022-4b58-ae8f-50bc2ba89188 req-0c5b0f68-e3da-477e-ab2f-c385380f7925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d082780b-e2a5-480f-9edf-5793b00ce795", "tag": "384961f9-0f01-4d12-864e-a14aa382c228"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:33.140817 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e788b1c1-9022-4b58-ae8f-50bc2ba89188 req-0c5b0f68-e3da-477e-ab2f-c385380f7925 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:33.141321 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e788b1c1-9022-4b58-ae8f-50bc2ba89188 req-0c5b0f68-e3da-477e-ab2f-c385380f7925 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:33.141750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e788b1c1-9022-4b58-ae8f-50bc2ba89188 req-0c5b0f68-e3da-477e-ab2f-c385380f7925 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:33.152832 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-e788b1c1-9022-4b58-ae8f-50bc2ba89188 req-0c5b0f68-e3da-477e-ab2f-c385380f7925 service nova] Creating event network-changed:384961f9-0f01-4d12-864e-a14aa382c228 for instance d082780b-e2a5-480f-9edf-5793b00ce795 on hv-cinder-85367 Aug 18 17:19:33.157714 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-e788b1c1-9022-4b58-ae8f-50bc2ba89188 req-0c5b0f68-e3da-477e-ab2f-c385380f7925 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031666 Aug 18 17:19:33.158340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 328/675] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:54.443693 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=28 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:54.444446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=25 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:54.448696 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:54.452639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:54.455760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:54.456242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:54.456674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:54.457360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:54.457811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:54.458234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:54.486806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-93b2d948-848c-4723-b579-83ba3822b631 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments/9c05c8dd-af07-4c12-a1c8-3bf4f212ef3a" status: 200 len: 194 microversion: 2.20 time: 0.044721 Aug 18 17:19:54.487395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 348/676] 10.222.0.82 () {60 vars in 1454 bytes} [Thu Aug 18 17:19:54 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments/9c05c8dd-af07-4c12-a1c8-3bf4f212ef3a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:19:54.550698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=30 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:54.554943 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:54.555515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:54.563102 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:54.563574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:54.563999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:54.564757 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:54.565205 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:54.565626 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:54.647000 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lazy-loading 'services' on Instance uuid a30b49e2-6995-4078-b762-0ac46cc2b043 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:19:54.856094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ef4ea6f5-f53b-4a39-b461-3244a3632ff0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments/9c05c8dd-af07-4c12-a1c8-3bf4f212ef3a" status: 202 len: 0 microversion: 2.20 time: 0.306571 Aug 18 17:19:54.856576 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 329/677] 10.222.0.82 () {60 vars in 1457 bytes} [Thu Aug 18 17:19:54 2022] DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments/9c05c8dd-af07-4c12-a1c8-3bf4f212ef3a => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:19:54.865768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:54.868032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:54.874270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:54.874746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:54.875203 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:54.875890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:54.876333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:54.876750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:54.906059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3af4bbba-c4ed-462c-8ded-5f7b65ace125 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Aug 18 17:19:54.906606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 349/678] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 17:19:54 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:19:55.920340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:55.922621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:55.928887 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:55.929366 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:55.929841 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:55.930543 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:55.931082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:55.931565 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:55.961996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3036b29e-42bb-4dba-b471-f4b92cd13374 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047347 Aug 18 17:19:55.962544 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 330/679] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 17:19:55 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:19:56.974439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:56.976598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:56.983620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:56.984093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:56.984519 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:56.985197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:56.985639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:56.986052 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:57.017569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-83a2a84e-0afd-4ed5-83ff-b7b0af752565 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046995 Aug 18 17:19:57.018103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 350/680] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 17:19:56 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:57.079559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:57.080067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:57.086062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:57.086546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:57.087081 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:57.087770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:57.088220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:57.088643 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:57.112470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:19:57.332582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a6584de6-0624-4edb-998e-555e1c729b72 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 204 len: 0 microversion: 2.20 time: 0.257416 Aug 18 17:19:57.333169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 331/681] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 17:19:57 2022] DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:19:57.341527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:57.345964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:57.349113 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:57.349592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:57.350024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:57.350710 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:57.351196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:57.351681 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:57.480333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:57.489056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:57.490548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:57.491732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-10f434e6-d841-4cda-901e-07902d88acc0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.154185 Aug 18 17:19:57.492277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 351/682] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:19:57 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:19:58.516290 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:58.516978 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:58.523293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:58.523769 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:58.524198 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:58.524883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:58.525328 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:58.525745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:58.658599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:58.666645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:58.668177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:58.669323 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-69c964d9-3786-48c6-8ae2-28351734f9b2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.157641 Aug 18 17:19:58.670491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 332/683] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:19:58 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:19:59.692959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:59.693500 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:59.699918 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:59.700429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:59.701993 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:59.702205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:59.702602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:59.703050 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:00.124810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:00.133100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:00.134580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:00.135762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-19499109-9aa2-4ebe-9157-cfe784cf875a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1722 microversion: 2.20 time: 0.446813 Aug 18 17:20:00.136312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 352/684] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:19:59 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:00.584128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-7e1060ba-d850-4221-8f0d-deb36f257cb6 req-95e8a13c-cdc8-441b-8e0e-62bdc99db2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30b49e2-6995-4078-b762-0ac46cc2b043", "name": "network-vif-deleted", "tag": "f34e0ea4-f63a-460d-b196-96d01a66c4b8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:00.595054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7e1060ba-d850-4221-8f0d-deb36f257cb6 req-95e8a13c-cdc8-441b-8e0e-62bdc99db2ea service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:00.595717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7e1060ba-d850-4221-8f0d-deb36f257cb6 req-95e8a13c-cdc8-441b-8e0e-62bdc99db2ea service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:00.596143 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7e1060ba-d850-4221-8f0d-deb36f257cb6 req-95e8a13c-cdc8-441b-8e0e-62bdc99db2ea service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:00.609700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-7e1060ba-d850-4221-8f0d-deb36f257cb6 req-95e8a13c-cdc8-441b-8e0e-62bdc99db2ea service nova] Creating event network-vif-deleted:f34e0ea4-f63a-460d-b196-96d01a66c4b8 for instance a30b49e2-6995-4078-b762-0ac46cc2b043 on hv-cinder-85367 Aug 18 17:20:00.615125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-7e1060ba-d850-4221-8f0d-deb36f257cb6 req-95e8a13c-cdc8-441b-8e0e-62bdc99db2ea service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097542 Aug 18 17:20:00.615968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 333/685] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:01.159376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:01.159996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:01.166355 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:01.166843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:01.167309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:01.168027 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:01.168484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:01.168915 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:01.202444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:01.203020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:01.203461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:01.203917 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lazy-loading 'fault' on Instance uuid a30b49e2-6995-4078-b762-0ac46cc2b043 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:20:01.254456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:01.269555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:01.271354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:01.273350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f1f63c24-37f5-48cf-b085-7ace2cd4af25 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 200 len: 1370 microversion: 2.20 time: 0.117460 Aug 18 17:20:01.279064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 353/686] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:01 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:02.310308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:02.311011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:02.317626 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:02.318103 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:02.318534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:02.319247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:02.319699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:02.320128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:02.334837 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] HTTP exception thrown: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Request method failure captured: Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 HTTP/1.1 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nL9yPhX9NHjLb9VJyIZKX5-t3t1XyG4gSiwUQ2NfnR-efTGilWzcttIydKpvg4ukufs9YenZfvD00cXwoWEtdlMSzco8YtP2YMNdThwkvsk0cEKOoGOTv1ML-Jc4gnYbKguC2uZbk3EBgKIBDS9kQfk1sK3RXhjihn2BoApXdoIq5o Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:20:02.336462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 22e737cba90b4d8890ecd692e6456470 Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:20:02.338128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'a30b49e2-6995-4078-b762-0ac46cc2b043'} Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:20:02.339356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:20:02.340859 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:02.343352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Returning 404 to user: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:20:02.343352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-09a4116b-5664-4c21-a4d2-96914f3f111a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 404 len: 111 microversion: 2.20 time: 0.032274 Aug 18 17:20:02.343352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 334/687] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:02 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:20:02.347214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-12a1fae6-44d1-4e82-9d96-81b7e6fef383 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '.version_select at 0x7fd1fb5b5e50>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:02.437393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-12a1fae6-44d1-4e82-9d96-81b7e6fef383 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772725575" status: 204 len: 0 microversion: 2.20 time: 0.093711 Aug 18 17:20:02.438020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 354/688] 10.222.0.82 () {60 vars in 1259 bytes} [Thu Aug 18 17:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772725575 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:20:03.280232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9c3d67bb-0c86-4259-88a6-69c26cd29983 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'create', calling method: .version_select at 0x7fd1f2be1820>, body: {"keypair": {"name": "tempest-keypair-422913678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR3dh/nDC9D3ZXFQwk3KAxJ2e3wEOD+9JiJ09a6/4VkYwIAQXep8QS8pw9GdN2179XmfQpHB3G4/XiGz9QmXnHYwHaygq2HPHF5Xi62HaCBLvrOYBtEp9nhidg0rwmwYg=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:03.295235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-9c3d67bb-0c86-4259-88a6-69c26cd29983 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:20:03.299141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-9c3d67bb-0c86-4259-88a6-69c26cd29983 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for user 22e737cba90b4d8890ecd692e6456470 and project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:20:03.401191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9c3d67bb-0c86-4259-88a6-69c26cd29983 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.124869 Aug 18 17:20:03.401864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 335/689] 10.222.0.82 () {62 vars in 1200 bytes} [Thu Aug 18 17:20:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 17:20:05.569457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-854777900", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66034e41-0280-4345-b321-88bd10e4e6db"}], "security_groups": [{"name": "tempest-securitygroup--2117181382"}], "key_name": "tempest-keypair-422913678", "user_data": "}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:05.672338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] validate_networks() for [('66034e41-0280-4345-b321-88bd10e4e6db', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:20:06.126940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:20:06.127369 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:20:06.127843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:20:06.128253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:20:06.128693 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:20:06.137532 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:06.138007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:06.138439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:06.139203 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:06.140256 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:06.140883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:06.158056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:20:06.162105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Getting quotas for user 22e737cba90b4d8890ecd692e6456470 and project d1d1a4ac5307416f8569267bf2f2d827. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:20:06.173295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:20:06.175718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:20:06.341780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-06171449-f922-45f7-b848-7df464012bd4 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.777180 Aug 18 17:20:06.342704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 355/690] 10.222.0.82 () {62 vars in 1188 bytes} [Thu Aug 18 17:20:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 17:20:06.353954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-379a8efb-3ce6-4b1f-bc0f-22ee84f26795 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:06.354640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-379a8efb-3ce6-4b1f-bc0f-22ee84f26795 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:06.415382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-379a8efb-3ce6-4b1f-bc0f-22ee84f26795 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:06.423720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-379a8efb-3ce6-4b1f-bc0f-22ee84f26795 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:06.425375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-379a8efb-3ce6-4b1f-bc0f-22ee84f26795 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:06.426574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-379a8efb-3ce6-4b1f-bc0f-22ee84f26795 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1280 microversion: 2.20 time: 0.077161 Aug 18 17:20:06.427167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 336/691] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:06 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:20:07.450664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:07.451348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:07.457946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:07.458426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:07.458866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:07.459592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:07.460038 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:07.460459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:07.524436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:07.533269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:07.534760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:07.535893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cc142784-fcb1-4fc9-aed5-4927a2373f5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1276 microversion: 2.20 time: 0.089758 Aug 18 17:20:07.536458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 356/692] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:07 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:08.561067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:08.561790 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:08.568549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:08.571111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:08.571111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:08.571111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:08.571111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:08.571513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:08.647705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:08.656697 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:08.658258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:08.659392 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5ced340f-595d-4ff1-b6b8-8d5620f9aa59 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1338 microversion: 2.20 time: 0.102476 Aug 18 17:20:08.659984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 337/693] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:08 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:09.688792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:09.689400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:09.695707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:09.696184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:09.696617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:09.697304 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:09.697753 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:09.698182 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:09.796793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-9f342ffa-f1e2-4b67-8da0-6721dfda5389 req-884ec942-2a39-4063-b6ac-9b575e011d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:09.807467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9f342ffa-f1e2-4b67-8da0-6721dfda5389 req-884ec942-2a39-4063-b6ac-9b575e011d4f service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:09.808228 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9f342ffa-f1e2-4b67-8da0-6721dfda5389 req-884ec942-2a39-4063-b6ac-9b575e011d4f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:09.808723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9f342ffa-f1e2-4b67-8da0-6721dfda5389 req-884ec942-2a39-4063-b6ac-9b575e011d4f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:09.822780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-9f342ffa-f1e2-4b67-8da0-6721dfda5389 req-884ec942-2a39-4063-b6ac-9b575e011d4f service nova] Creating event network-changed:5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e for instance 9b3a9074-980b-4900-941f-59ac5d780fef on hv-cinder-85367 Aug 18 17:20:09.829160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-9f342ffa-f1e2-4b67-8da0-6721dfda5389 req-884ec942-2a39-4063-b6ac-9b575e011d4f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035776 Aug 18 17:20:09.829938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 338/694] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:09.915920 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:09.924257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:09.925760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:09.926870 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d523d22e-fab3-41ea-923c-09ce1fae8882 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.242823 Aug 18 17:20:09.927454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 357/695] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:09 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:10.950152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:10.950865 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:10.958375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:10.958847 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:10.965781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:10.965781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:10.965781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:10.965781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:11.096118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:11.104430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:11.105940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:11.107090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5b492483-9cc6-4e2a-80bd-d47e67b0e47d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.161131 Aug 18 17:20:11.107674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 339/696] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:10 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:12.128729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:12.129330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:12.135734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:12.136207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:12.136631 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:12.137314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:12.137761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:12.138178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:12.267352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:12.275424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:12.276913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:12.278001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a63a31a9-0851-4324-ad53-fbda2ccce01a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.153466 Aug 18 17:20:12.278549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 358/697] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:12 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:13.300946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:13.301544 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:13.307902 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:13.308375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:13.308804 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:13.309483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:13.309928 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:13.310349 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:13.442053 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:13.450281 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:13.451799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:13.453675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-75d5e376-faa8-4004-b091-4d7a551142ce tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.156676 Aug 18 17:20:13.454266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 340/698] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:13 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:14.476195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:14.476807 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:14.483215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:14.484398 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:14.484850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:14.485584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:14.486063 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:14.486484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:14.613237 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:14.621216 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:14.622698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:14.623866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a2adb275-5c0d-4881-b716-2d67f6efe67f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.151492 Aug 18 17:20:14.624621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 359/699] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:14 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:15.645917 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:15.646517 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:15.652861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:15.653332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:15.653766 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:15.654446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:15.654890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:15.655332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:15.781853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:15.789932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:15.791726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:15.792828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c5387024-85dc-474c-9c34-999205112438 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.150779 Aug 18 17:20:15.793382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 341/700] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:15 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:16.817318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:16.817951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:16.820770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:16.821450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:16.826828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:16.827356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:16.827797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:16.828773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:16.829242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:16.829671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:16.937276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-2e8628e5-5355-4451-ab41-5c91520a0be9 req-c344b20a-94a4-4f31-9e8f-a637f83dadc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "name": "network-vif-plugged", "status": "completed", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:16.948131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:16.950672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-2e8628e5-5355-4451-ab41-5c91520a0be9 req-c344b20a-94a4-4f31-9e8f-a637f83dadc5 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:16.951183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-2e8628e5-5355-4451-ab41-5c91520a0be9 req-c344b20a-94a4-4f31-9e8f-a637f83dadc5 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:16.951619 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-2e8628e5-5355-4451-ab41-5c91520a0be9 req-c344b20a-94a4-4f31-9e8f-a637f83dadc5 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:16.963360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-2e8628e5-5355-4451-ab41-5c91520a0be9 req-c344b20a-94a4-4f31-9e8f-a637f83dadc5 service nova] Creating event network-vif-plugged:5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e for instance 9b3a9074-980b-4900-941f-59ac5d780fef on hv-cinder-85367 Aug 18 17:20:16.968503 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-2e8628e5-5355-4451-ab41-5c91520a0be9 req-c344b20a-94a4-4f31-9e8f-a637f83dadc5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034838 Aug 18 17:20:16.969781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 342/701] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:20:16.981123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:16.989639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:16.991267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:16.992370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-901ceb18-c234-4a37-9315-221667429e01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.180449 Aug 18 17:20:16.992926 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 360/702] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:16 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:18.015843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:18.017703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:18.026388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:18.026864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:18.027318 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:18.028003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:18.028458 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:18.028870 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:18.161470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:18.169558 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:18.171070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:18.172234 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-56cd97a4-2ab7-400f-98dd-f042cef3f44a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.161057 Aug 18 17:20:18.172830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 343/703] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:18 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:19.194530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:19.195160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:19.201508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:19.202014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:19.202443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:19.203244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:19.204352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:19.204772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:19.335570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:19.343970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:19.345990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:19.347125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2ff2b137-8ae4-4a8c-aaa2-adf6e821a491 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1406 microversion: 2.20 time: 0.156578 Aug 18 17:20:19.347683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 361/704] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:19 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:20.368629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:20.369232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:20.375915 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:20.376477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:20.376912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:20.377602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:20.378050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:20.378580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:20.509789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:20.517990 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:20.519531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:20.520673 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e1b4b05d-606a-4de4-b924-31c112cf3406 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1597 microversion: 2.20 time: 0.155932 Aug 18 17:20:20.521230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 344/705] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:20:20 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:20:20.542447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:20.543030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:20.550027 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:20.550500 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:20.550954 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:20.551647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:20.552098 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:20.552522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:20.630396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ec8458ce-e126-4264-a04b-17e4609a8a05 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091691 Aug 18 17:20:20.631012 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 362/706] 10.222.0.82 () {60 vars in 1316 bytes} [Thu Aug 18 17:20:20 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:20:21.844715 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-53178f0a-a750-4ed4-89c6-53ad05321622 req-08978751-0d03-47b9-b2a1-7c350f1eedc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:21.854432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-53178f0a-a750-4ed4-89c6-53ad05321622 req-08978751-0d03-47b9-b2a1-7c350f1eedc8 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:21.854930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-53178f0a-a750-4ed4-89c6-53ad05321622 req-08978751-0d03-47b9-b2a1-7c350f1eedc8 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:21.855359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-53178f0a-a750-4ed4-89c6-53ad05321622 req-08978751-0d03-47b9-b2a1-7c350f1eedc8 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:21.866473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-53178f0a-a750-4ed4-89c6-53ad05321622 req-08978751-0d03-47b9-b2a1-7c350f1eedc8 service nova] Creating event network-changed:5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e for instance 9b3a9074-980b-4900-941f-59ac5d780fef on hv-cinder-85367 Aug 18 17:20:21.871462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-53178f0a-a750-4ed4-89c6-53ad05321622 req-08978751-0d03-47b9-b2a1-7c350f1eedc8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030457 Aug 18 17:20:21.872122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 345/707] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:25.875570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:25.876244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:25.877923 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:25.882581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:25.883130 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:25.883566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:25.884252 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:25.884703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:25.885125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:25.888843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=81 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:25.970257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'services' on Instance uuid d082780b-e2a5-480f-9edf-5793b00ce795 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:20:26.276619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-47a0619b-9d41-4455-bb98-4625b07c60c5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments/818cd3c2-22d1-4165-8912-0f3dc5dcef64" status: 202 len: 0 microversion: 2.1 time: 0.405279 Aug 18 17:20:26.277222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 363/708] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:20:25 2022] DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments/818cd3c2-22d1-4165-8912-0f3dc5dcef64 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:20:26.286360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:26.288629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:26.291196 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:26.295966 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:26.296443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:26.296996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:26.297794 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:26.298247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:26.298668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:26.302302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:26.328285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a517ed18-af7f-4fe7-bc12-311d2a4be758 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Aug 18 17:20:26.329515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 346/709] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:20:26 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:27.342696 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:27.345099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:27.351948 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:27.352433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:27.352865 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:27.353552 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:27.354003 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:27.354529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:27.384628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-56270fe8-87c9-443e-bd7b-b2fecb1391c6 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Aug 18 17:20:27.385180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 364/710] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:20:27 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:28.397925 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:28.400107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:28.407041 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:28.407526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:28.407971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:28.409489 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:28.409839 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:28.410272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:28.440438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c2aa7b7c-1752-4eb9-afa8-03d5a36a435c tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047220 Aug 18 17:20:28.441027 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 347/711] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:20:28 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:20:28.516683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:28.517195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:28.523741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:28.524223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:28.524665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:28.525356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:28.525806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:28.526229 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:28.553343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Going to try to terminate instance {{(pid=121216) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:20:28.871152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5a4f54ff-e9f1-43e1-85b8-d28b52fff5c1 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 204 len: 0 microversion: 2.1 time: 0.357908 Aug 18 17:20:28.871737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 365/712] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:20:28 2022] DELETE /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:20:28.879989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:28.880602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:28.887624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:28.888106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:28.888547 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:28.889241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:28.889693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:28.890120 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:29.020176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:29.027768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1bf64694-2212-4679-8759-aac13c0e838e tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1690 microversion: 2.1 time: 0.151859 Aug 18 17:20:29.028334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 348/713] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:28 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:20:30.048335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:30.049064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:30.055612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:30.056090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:30.056523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:30.057210 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:30.057666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:30.058087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:30.189517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:30.197909 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7d7f0768-4b99-405b-bd57-58d23f9b73d0 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1690 microversion: 2.1 time: 0.153864 Aug 18 17:20:30.198467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 366/714] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:30 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:31.219250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:31.219864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:31.226272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:31.226756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:31.227236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:31.227933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:31.228389 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:31.228818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:31.355775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:31.364064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e12f6ac8-89f1-4bca-9c0e-af2f3f39396a tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1690 microversion: 2.1 time: 0.148714 Aug 18 17:20:31.364635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 349/715] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:31 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:32.384594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:32.386449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:32.391963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:32.392444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:32.392880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:32.393581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:32.394032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:32.395060 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:32.622204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:32.630492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bca8fd7d-85ae-429b-90b9-f5eb9bc398c4 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1690 microversion: 2.1 time: 0.249942 Aug 18 17:20:32.631075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 367/716] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:32 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:33.314352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-dce26a6e-de25-4cf6-9de0-c61c4898e7c6 req-1b186459-63e2-4488-8c8d-0b37c6641157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d082780b-e2a5-480f-9edf-5793b00ce795", "name": "network-vif-deleted", "tag": "384961f9-0f01-4d12-864e-a14aa382c228"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:33.324637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-dce26a6e-de25-4cf6-9de0-c61c4898e7c6 req-1b186459-63e2-4488-8c8d-0b37c6641157 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:33.325115 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-dce26a6e-de25-4cf6-9de0-c61c4898e7c6 req-1b186459-63e2-4488-8c8d-0b37c6641157 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:33.325599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-dce26a6e-de25-4cf6-9de0-c61c4898e7c6 req-1b186459-63e2-4488-8c8d-0b37c6641157 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:33.336815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-dce26a6e-de25-4cf6-9de0-c61c4898e7c6 req-1b186459-63e2-4488-8c8d-0b37c6641157 service nova] Creating event network-vif-deleted:384961f9-0f01-4d12-864e-a14aa382c228 for instance d082780b-e2a5-480f-9edf-5793b00ce795 on hv-cinder-85367 Aug 18 17:20:33.341762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-dce26a6e-de25-4cf6-9de0-c61c4898e7c6 req-1b186459-63e2-4488-8c8d-0b37c6641157 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Aug 18 17:20:33.342365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 350/717] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:33.651330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:33.651933 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:33.658178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:33.658658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:33.659206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:33.660394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:33.660853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:33.661292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:33.693163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:33.693645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:33.694086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:33.694537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'fault' on Instance uuid d082780b-e2a5-480f-9edf-5793b00ce795 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:20:33.736875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:33.745565 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8e602e8c-82f7-4ca1-bde2-c5702855fabe tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 200 len: 1336 microversion: 2.1 time: 0.098222 Aug 18 17:20:33.746134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 368/718] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:33 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:34.767835 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:34.768814 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: d082780b-e2a5-480f-9edf-5793b00ce795] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:34.774738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:34.775256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:34.775694 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:34.776403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:34.776861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:34.777311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:34.790825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] HTTP exception thrown: Instance d082780b-e2a5-480f-9edf-5793b00ce795 could not be found. Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Request method failure captured: Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 HTTP/1.1 Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nMBn6eQh4g6Ef-NDef2IXjmOxcIYI3WcPprGjEubTNTP544Ce_YGDSQbTI-KX9h5KLLurAQ8LYiP0SZ5Fu7D_E3bKe78ANfioYKnRjWXFwcupQvS9ZQDVOYsDpFa5rCMzANCP2fMFZJEw6Zkt0qjHTElMZ1rhcr8QJt9L7iLkwE8Ck Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:20:34.792463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/289886000851431da2e3aebc3b47be8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: ecdea0572cc64ca394cd4d977f536d5a Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance d082780b-e2a5-480f-9edf-5793b00ce795 could not be found. Aug 18 17:20:34.794069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'd082780b-e2a5-480f-9edf-5793b00ce795'} Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d082780b-e2a5-480f-9edf-5793b00ce795 could not be found. Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:20:34.794890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d082780b-e2a5-480f-9edf-5793b00ce795 could not be found. Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d082780b-e2a5-480f-9edf-5793b00ce795 could not be found. Aug 18 17:20:34.796189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:34.797300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Returning 404 to user: Instance d082780b-e2a5-480f-9edf-5793b00ce795 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:20:34.797300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8827c447-c8b9-4564-b883-bfb048464d04 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795" status: 404 len: 111 microversion: 2.1 time: 0.030833 Aug 18 17:20:34.797300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 351/719] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:34 2022] GET /compute/v2.1/servers/d082780b-e2a5-480f-9edf-5793b00ce795 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:20:34.803057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f1f3d767-735d-40ec-a396-905c467e6f8d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '.version_select at 0x7fd1fb5d7430>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:34.900657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f1f3d767-735d-40ec-a396-905c467e6f8d tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011686297" status: 202 len: 0 microversion: 2.1 time: 0.101870 Aug 18 17:20:34.901243 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 369/720] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 17:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011686297 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:20:36.119337 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:36.119877 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:36.125921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:36.126461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:36.126935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:36.133628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:36.133628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:36.133628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:36.152992 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lazy-loading 'flavor' on Instance uuid c9e02d3e-7dbb-4aba-9fcd-357539efba50 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:20:36.373161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5ded83e3-7c8d-476a-a186-bd8bb2d0cb8b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "POST /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50/action" status: 202 len: 0 microversion: 2.1 time: 0.389659 Aug 18 17:20:36.373757 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 352/721] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:20:35 2022] POST /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:20:36.383073 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:36.383685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:36.390170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:36.390654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:36.391126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:36.391817 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:36.392267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:36.392687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:36.524971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:36.532673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-996612bf-f859-4859-9a88-4a41c7f4d9c6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.154577 Aug 18 17:20:36.533233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 370/722] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:36 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:37.554618 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:37.560114 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:37.561510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:37.561993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:37.562424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:37.563148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:37.563855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:37.564310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:37.700494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:37.709787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-283b4f2a-9caf-4497-a7b6-24b08952786f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.159860 Aug 18 17:20:37.710356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 353/723] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:37 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:38.133039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:38.133544 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:38.140089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:38.140571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:38.141010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:38.141787 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:38.142243 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:38.142669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:38.168178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Going to try to terminate instance {{(pid=121216) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:20:38.480984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-251970d2-37c6-4d90-8bfc-456229f70723 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "DELETE /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 204 len: 0 microversion: 2.1 time: 0.351498 Aug 18 17:20:38.481577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 371/724] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:20:38 2022] DELETE /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:20:38.489826 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:38.490445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:38.496777 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:38.497316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:38.506884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:38.506884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:38.506884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:38.506884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:38.627009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:38.635874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2995dfd7-4bc3-4bf6-8ac5-e637f5d67a69 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1507 microversion: 2.1 time: 0.150198 Aug 18 17:20:38.636436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 354/725] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:38 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:38.731814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:38.732433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:38.738422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:38.738914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:38.741863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:38.741863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:38.741863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:38.741863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:38.876496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:38.884346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5f540dd0-c1f3-4759-9d4f-b39c154254dc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.156734 Aug 18 17:20:38.884914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 372/726] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:38 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:39.656753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:39.658062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:39.665268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:39.666007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:39.667588 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:39.668457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:39.669068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:39.669898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:39.737857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-beeb89ce-8fae-4735-9c09-090ff70f1236 req-0185aed8-ef74-446a-a92e-f6448048906b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f96a52-4974-4053-bbf5-4719d7be5671", "name": "network-vif-deleted", "tag": "2804c6c6-54ad-4beb-995c-9d13bb1213db"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:39.749310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-beeb89ce-8fae-4735-9c09-090ff70f1236 req-0185aed8-ef74-446a-a92e-f6448048906b service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:39.749899 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-beeb89ce-8fae-4735-9c09-090ff70f1236 req-0185aed8-ef74-446a-a92e-f6448048906b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:39.750031 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:39.750530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-beeb89ce-8fae-4735-9c09-090ff70f1236 req-0185aed8-ef74-446a-a92e-f6448048906b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:39.758588 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-29226043-729b-4a4f-86f3-650e7ad062e5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1465 microversion: 2.1 time: 0.105564 Aug 18 17:20:39.759529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 355/727] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:39 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1465 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:39.765613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-beeb89ce-8fae-4735-9c09-090ff70f1236 req-0185aed8-ef74-446a-a92e-f6448048906b service nova] Creating event network-vif-deleted:2804c6c6-54ad-4beb-995c-9d13bb1213db for instance 41f96a52-4974-4053-bbf5-4719d7be5671 on hv-cinder-85367 Aug 18 17:20:39.776609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-beeb89ce-8fae-4735-9c09-090ff70f1236 req-0185aed8-ef74-446a-a92e-f6448048906b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045030 Aug 18 17:20:39.782110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 373/728] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:20:39.905770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:39.906308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:39.912430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:39.913690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:39.913690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:39.914013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:39.914468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:39.914890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:40.054883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:40.063549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-471d18c4-9df7-46ca-a274-656fd976ac2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.161654 Aug 18 17:20:40.064143 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 356/729] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:39 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:40.781050 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:40.781739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:40.789273 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:40.795021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:40.795021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:40.795021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:40.795021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:40.795431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:40.823271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:40.823744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:40.824173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:40.828665 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'fault' on Instance uuid 41f96a52-4974-4053-bbf5-4719d7be5671 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:20:40.866664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:40.874296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c24b6bae-9b75-45ae-936f-2cb72618b64b tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 200 len: 1311 microversion: 2.1 time: 0.098071 Aug 18 17:20:40.874950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 374/730] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:40 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:41.085797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:41.086409 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:41.092956 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:41.093413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:41.093849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:41.094538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:41.095024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:41.095450 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:41.227960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:41.235701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c5567c83-b312-4dcb-8d9e-88893677e19a tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.153907 Aug 18 17:20:41.236267 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 357/731] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:41 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:41.894343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:41.894970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 41f96a52-4974-4053-bbf5-4719d7be5671] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:41.902171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:41.902639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:41.903107 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:41.903814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:41.904261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:41.904679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:41.917928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] HTTP exception thrown: Instance 41f96a52-4974-4053-bbf5-4719d7be5671 could not be found. Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Request method failure captured: Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 HTTP/1.1 Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nMBn6eQh4g6Ef-NDef2IXjmOxcIYI3WcPprGjEubTNTP544Ce_YGDSQbTI-KX9h5KLLurAQ8LYiP0SZ5Fu7D_E3bKe78ANfioYKnRjWXFwcupQvS9ZQDVOYsDpFa5rCMzANCP2fMFZJEw6Zkt0qjHTElMZ1rhcr8QJt9L7iLkwE8Ck Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:20:41.919566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/289886000851431da2e3aebc3b47be8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: ecdea0572cc64ca394cd4d977f536d5a Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 41f96a52-4974-4053-bbf5-4719d7be5671 could not be found. Aug 18 17:20:41.921090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '41f96a52-4974-4053-bbf5-4719d7be5671'} Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f96a52-4974-4053-bbf5-4719d7be5671 could not be found. Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:20:41.922134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f96a52-4974-4053-bbf5-4719d7be5671 could not be found. Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f96a52-4974-4053-bbf5-4719d7be5671 could not be found. Aug 18 17:20:41.923660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:41.925077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Returning 404 to user: Instance 41f96a52-4974-4053-bbf5-4719d7be5671 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:20:41.925077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a39e72e9-c415-41ae-9ba2-adec631c1180 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671" status: 404 len: 111 microversion: 2.1 time: 0.030423 Aug 18 17:20:41.925077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 375/732] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:41 2022] GET /compute/v2.1/servers/41f96a52-4974-4053-bbf5-4719d7be5671 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:20:41.929409 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:41.929907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:41.935851 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:41.936332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:41.936771 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:41.937463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:41.937919 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:41.938761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:41.964558 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:20:42.218292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8c86b80d-0854-4f16-ba3e-b978d6069533 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 204 len: 0 microversion: 2.1 time: 0.292427 Aug 18 17:20:42.218967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 358/733] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:20:41 2022] DELETE /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:20:42.227125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:42.229712 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:42.234281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:42.234771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:42.235233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:42.235931 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:42.236387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:42.236810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:42.258675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:42.259347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:42.265282 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:42.265761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:42.266196 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:42.266892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:42.267418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:42.267975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:42.443093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:42.443093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-99e3aa1c-faaf-431f-83aa-312f6326f5a2 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.216843 Aug 18 17:20:42.443093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 376/734] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:42 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:42.458782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:42.466810 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3180cb6b-5deb-4a85-a245-91d6652f5283 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.213173 Aug 18 17:20:42.467419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 359/735] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:42 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:43.460965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:43.461535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:43.468149 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:43.469014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:43.469235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:43.469928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:43.470381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:43.470804 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:43.487159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:43.488292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:43.488910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:43.497633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:43.498124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:43.498565 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:43.499307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:43.499762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:43.500265 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:43.515964 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:43.738049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:43.746019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ebcdbeb2-a1cb-4a29-8b74-83b3fcabe3a5 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1522 microversion: 2.1 time: 0.289402 Aug 18 17:20:43.746612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 377/736] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:43 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:43.751922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:43.759932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dc0dae57-8594-4b6f-811f-68e8ad4ee44e tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.275719 Aug 18 17:20:43.764514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 360/737] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:43 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:20:43.942624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-887dddf3-18c4-4b6c-873b-df2f6c4bcb08 req-60904295-0c90-446f-88e4-47afa0d83f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e590ac9-d3f2-4279-aba4-d75780182977", "name": "network-vif-deleted", "tag": "82e703d0-eff7-4aa8-b74e-aa30f2ed3ac1"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:43.952452 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-887dddf3-18c4-4b6c-873b-df2f6c4bcb08 req-60904295-0c90-446f-88e4-47afa0d83f6c service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:43.952927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-887dddf3-18c4-4b6c-873b-df2f6c4bcb08 req-60904295-0c90-446f-88e4-47afa0d83f6c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:43.953357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-887dddf3-18c4-4b6c-873b-df2f6c4bcb08 req-60904295-0c90-446f-88e4-47afa0d83f6c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:43.966039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-887dddf3-18c4-4b6c-873b-df2f6c4bcb08 req-60904295-0c90-446f-88e4-47afa0d83f6c service nova] Creating event network-vif-deleted:82e703d0-eff7-4aa8-b74e-aa30f2ed3ac1 for instance 1e590ac9-d3f2-4279-aba4-d75780182977 on hv-cinder-85367 Aug 18 17:20:43.971746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-887dddf3-18c4-4b6c-873b-df2f6c4bcb08 req-60904295-0c90-446f-88e4-47afa0d83f6c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 Aug 18 17:20:43.972669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 378/738] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:44.767437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:44.783471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:44.783471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:44.783471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:44.783471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:44.783898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:44.783898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:44.783898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:44.784155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:44.784155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:44.799037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:44.799037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:44.799037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:44.799037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:44.799445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:44.799445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:44.828521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:44.829158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:44.829750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:44.830245 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lazy-loading 'fault' on Instance uuid 1e590ac9-d3f2-4279-aba4-d75780182977 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:20:44.889230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdea0572cc64ca394cd4d977f536d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289886000851431da2e3aebc3b47be8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:44.897875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-41003aca-d7f0-4ed6-8452-5e5765420db9 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 200 len: 1312 microversion: 2.1 time: 0.134442 Aug 18 17:20:44.901788 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 361/739] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:44 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 1312 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:44.980859 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:44.988576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5084f9e6-7ba7-4df3-baf8-3d741560221f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.210474 Aug 18 17:20:44.989159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 379/740] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:44 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:20:45.918579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:45.919150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] [instance: 1e590ac9-d3f2-4279-aba4-d75780182977] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:45.925564 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:45.926038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:45.926470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:45.927312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:45.927801 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:45.928223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:45.941354 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] HTTP exception thrown: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 could not be found. Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Request method failure captured: Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 HTTP/1.1 Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nMBn6eQh4g6Ef-NDef2IXjmOxcIYI3WcPprGjEubTNTP544Ce_YGDSQbTI-KX9h5KLLurAQ8LYiP0SZ5Fu7D_E3bKe78ANfioYKnRjWXFwcupQvS9ZQDVOYsDpFa5rCMzANCP2fMFZJEw6Zkt0qjHTElMZ1rhcr8QJt9L7iLkwE8Ck Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:20:45.943642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/289886000851431da2e3aebc3b47be8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/289886000851431da2e3aebc3b47be8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 289886000851431da2e3aebc3b47be8a Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-951451975 Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: ecdea0572cc64ca394cd4d977f536d5a Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-951451975-project Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 could not be found. Aug 18 17:20:45.945256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '1e590ac9-d3f2-4279-aba4-d75780182977'} Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 could not be found. Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:20:45.946195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 could not be found. Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 could not be found. Aug 18 17:20:45.947791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:20:45.949199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] Returning 404 to user: Instance 1e590ac9-d3f2-4279-aba4-d75780182977 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:20:45.949199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3bb7d4eb-7dd4-4980-ae78-1f5046d0f695 tempest-ServerRescueNegativeTestJSON-951451975 tempest-ServerRescueNegativeTestJSON-951451975-project] 10.222.0.82 "GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977" status: 404 len: 111 microversion: 2.1 time: 0.030315 Aug 18 17:20:45.949199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 362/741] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:45 2022] GET /compute/v2.1/servers/1e590ac9-d3f2-4279-aba4-d75780182977 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:20:46.010108 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:46.010726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:46.017031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:46.017507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:46.017940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:46.018638 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:46.019116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:46.019539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:46.159461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:46.167796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7b654390-5171-4846-b32f-cfa66512fdb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.161412 Aug 18 17:20:46.168368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 380/742] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:46 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:47.189861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:47.191147 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:47.198947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:47.207332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:47.207332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:47.207332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:47.207332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:47.207700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:47.212141 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:47.212690 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:47.220808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:47.221294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:47.221950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:47.222821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:47.223463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:47.224290 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:47.250702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Going to try to terminate instance {{(pid=121216) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:20:47.378688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:47.386732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3d3d8a9f-f9a9-4a2e-9bc3-fa2441e28d40 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.201022 Aug 18 17:20:47.387386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 363/743] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:47 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:47.466123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-da77ac3f-4c2e-488c-8885-f11c5a593eb2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 204 len: 0 microversion: 2.1 time: 0.258216 Aug 18 17:20:47.466841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 381/744] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:20:47 2022] DELETE /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:20:47.475648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:47.476266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:47.482138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:47.482618 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:47.483101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:47.483806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:47.484260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:47.484685 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:47.619649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:47.627532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ed75031e-5b0c-4c54-add7-125fff093131 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1576 microversion: 2.1 time: 0.156428 Aug 18 17:20:47.628061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 364/745] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:47 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:48.408253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:48.408831 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:48.415427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:48.415915 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:48.416347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:48.417032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:48.417516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:48.417944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:48.570212 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:48.578041 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ff150dfe-d3d4-4397-b9ba-b4bcde9a7539 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.174205 Aug 18 17:20:48.578698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 382/746] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:48 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:48.752060 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:48.752675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:48.759198 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:48.759680 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:48.760116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:48.760857 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:48.761308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:48.761730 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:48.907849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:48.916530 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6e3c5301-e3ba-4504-b063-7350a8097d79 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1576 microversion: 2.1 time: 0.272400 Aug 18 17:20:48.917072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 365/747] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:48 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1576 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:49.602835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:49.603626 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:49.612274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:49.613447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:49.614988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:49.616493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:49.617019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:49.617511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:49.776383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:49.787943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fc3b51d3-0a3b-4e41-b56f-bc3e174bca11 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.191844 Aug 18 17:20:49.788529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 383/748] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:49 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:49.937977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:49.938837 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:49.950024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:49.950504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:49.951139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:49.952017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:49.952632 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:49.953053 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:50.224423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:50.231972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dee115bb-a69e-4968-be94-8a71b64d54a3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1576 microversion: 2.1 time: 0.298185 Aug 18 17:20:50.235096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 366/749] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:49 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1576 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:50.808825 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:50.816455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:50.817190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:50.818274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:50.818745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:50.819487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:50.819942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:50.820360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.033071 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-4c2173b3-3cbd-468f-827b-fa3019f935b4 req-aa4d063c-e606-4124-8ef2-bbc3b12be58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "name": "network-vif-unplugged", "status": "completed", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:51.049838 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-4c2173b3-3cbd-468f-827b-fa3019f935b4 req-aa4d063c-e606-4124-8ef2-bbc3b12be58d service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:51.050610 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-4c2173b3-3cbd-468f-827b-fa3019f935b4 req-aa4d063c-e606-4124-8ef2-bbc3b12be58d service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:51.051014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-4c2173b3-3cbd-468f-827b-fa3019f935b4 req-aa4d063c-e606-4124-8ef2-bbc3b12be58d service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.066307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-4c2173b3-3cbd-468f-827b-fa3019f935b4 req-aa4d063c-e606-4124-8ef2-bbc3b12be58d service nova] Creating event network-vif-unplugged:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:20:51.080708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:51.084272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-4c2173b3-3cbd-468f-827b-fa3019f935b4 req-aa4d063c-e606-4124-8ef2-bbc3b12be58d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052256 Aug 18 17:20:51.085639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 367/750] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:51.092857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fbf90ad3-2615-4991-868f-8280f71fa6f1 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1569 microversion: 2.1 time: 0.284314 Aug 18 17:20:51.093794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 384/751] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:50 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:51.118752 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:51.118752 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:51.131872 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:51.132799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:51.133404 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.134283 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:51.135066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:51.135904 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.168399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-89708892-ad8e-4fd3-92de-37844ca2a050 req-dd6ec876-2da8-431c-a832-ad72624599f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1732a5ad-82ea-4429-ab40-0dd58302edd8", "name": "network-vif-deleted", "tag": "0ec9e6c7-bd54-41cf-a346-2a13d678300a"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:51.181442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121217) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 17:20:51.185768 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-89708892-ad8e-4fd3-92de-37844ca2a050 req-dd6ec876-2da8-431c-a832-ad72624599f7 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:51.186292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-89708892-ad8e-4fd3-92de-37844ca2a050 req-dd6ec876-2da8-431c-a832-ad72624599f7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:51.187459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-89708892-ad8e-4fd3-92de-37844ca2a050 req-dd6ec876-2da8-431c-a832-ad72624599f7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.212523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-89708892-ad8e-4fd3-92de-37844ca2a050 req-dd6ec876-2da8-431c-a832-ad72624599f7 service nova] Creating event network-vif-deleted:0ec9e6c7-bd54-41cf-a346-2a13d678300a for instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 on hv-cinder-85367 Aug 18 17:20:51.218520 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-89708892-ad8e-4fd3-92de-37844ca2a050 req-dd6ec876-2da8-431c-a832-ad72624599f7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054129 Aug 18 17:20:51.222118 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 385/752] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:20:51.254445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:51.255707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:51.262104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:51.262963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:51.263372 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.264071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:51.264700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:51.265278 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:51.348342 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:51.358302 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-105f706b-49c7-4c79-a987-64ecd7dd7108 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 200 len: 1508 microversion: 2.1 time: 0.108134 Aug 18 17:20:51.363096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 386/753] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:51 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 1508 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:51.495210 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [7e8f126c-592c-4fe2-a255-07f249db887e] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 17:20:52.384307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:52.385050 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:52.391882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:52.392371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:52.392868 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:52.393599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:52.394084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:52.394536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:52.418884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] HTTP exception thrown: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Request method failure captured: Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 HTTP/1.1 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nO8YRAD-VPGAmg2nioUy6no7hOCLDRYlDkpSuQDV8IciyNq8MYgc_Kt9lDpkiyS_jAfzNHk0QFhggqiH626PHXaebgwD4ws7nnKUoEqJXUI-4pdn6a3keKpX6CYqA3JvFgCgY7dzA4vM94QK58YLuZZe7mYdFXabv-p45LsM1Dvxw8 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:20:52.420905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 04ab53c336934355a0000bda59fa7e7c Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:20:52.422525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '1732a5ad-82ea-4429-ab40-0dd58302edd8'} Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:20:52.423584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:20:52.424996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:20:52.428510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Returning 404 to user: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:20:52.429630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ac9ee0ed-612d-490b-802d-32ef0601940a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 404 len: 111 microversion: 2.1 time: 0.049697 Aug 18 17:20:52.430186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 387/754] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:52 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:20:52.503569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [7e8f126c-592c-4fe2-a255-07f249db887e] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 38872. Aug 18 17:20:52.507849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9363bbad-0013-4439-ba08-fa15df2d7a75 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "POST /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50/action" status: 202 len: 0 microversion: 2.1 time: 1.395813 Aug 18 17:20:52.508468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 368/755] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:20:51 2022] POST /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50/action => generated 0 bytes in 1398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:20:52.534440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:52.535098 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:52.543233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-406631412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-959238922", "security_groups": [{"name": "tempest-secgroup-smoke-1712538356"}], "block_device_mapping_v2": [{"uuid": "5ee49942-da8a-417e-8963-08f3bb1ed951", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0c6229eb-eed2-4407-a072-5471b2488cad"}]}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:52.553441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:52.555135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:52.555683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:52.556743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:52.557295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:52.558985 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:52.713131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] validate_networks() for [('0c6229eb-eed2-4407-a072-5471b2488cad', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:20:52.795496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:52.804413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6a366a19-5bb5-4b16-86d7-b34b686403f3 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1517 microversion: 2.1 time: 0.283984 Aug 18 17:20:52.805129 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 388/756] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:52 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1517 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:53.123930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:20:53.123930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:20:53.123930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:20:53.123930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:20:53.123930 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:20:53.132951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:53.133437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:53.133871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:53.134601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:53.135113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:53.135543 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:53.153079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for project e976b3d87de347818a3c62fa4806db98. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:20:53.157157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for user 04ab53c336934355a0000bda59fa7e7c and project e976b3d87de347818a3c62fa4806db98. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:20:53.221250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:20:53.223338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ee49942-da8a-417e-8963-08f3bb1ed951',volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:20:53.627881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2aa60902-3f3d-43a7-9d4a-4c856dbb1779 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093206 Aug 18 17:20:53.629260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 369/757] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:20:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:20:53.640797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-eea1749c-0d39-4ac8-a897-6a4432a9c84b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:53.641424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-eea1749c-0d39-4ac8-a897-6a4432a9c84b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:53.724166 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-eea1749c-0d39-4ac8-a897-6a4432a9c84b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:53.731148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-eea1749c-0d39-4ac8-a897-6a4432a9c84b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1093 microversion: 2.1 time: 0.094405 Aug 18 17:20:53.733661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 389/758] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:53 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1093 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:20:53.826474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:53.827517 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:53.834578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:53.839727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:53.839727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:53.839727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:53.839727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:53.840079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:54.022529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:54.032242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b8fb1469-d5e5-453e-9156-ff9d166f7194 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1517 microversion: 2.1 time: 0.210476 Aug 18 17:20:54.039146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 370/759] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:53 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1517 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:54.753663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4e50f2ff-170c-4a72-8d85-f6ca906596ec tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:54.754274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4e50f2ff-170c-4a72-8d85-f6ca906596ec tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:54.826375 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e50f2ff-170c-4a72-8d85-f6ca906596ec tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:54.836120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4e50f2ff-170c-4a72-8d85-f6ca906596ec tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1093 microversion: 2.1 time: 0.085004 Aug 18 17:20:54.840112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 390/760] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:54 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:20:55.056813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:55.057448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:55.065117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:55.065866 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:55.066461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:55.068470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:55.069188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:55.069812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:55.244749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:55.253196 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-eb8eb5e8-743a-4469-b1ac-e1f395dcaf6f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1517 microversion: 2.1 time: 0.202399 Aug 18 17:20:55.254668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 371/761] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:55 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:55.861099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a8647758-7b37-4019-a668-5318143409d7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:55.861718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a8647758-7b37-4019-a668-5318143409d7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:55.916220 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a8647758-7b37-4019-a668-5318143409d7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:55.924135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a8647758-7b37-4019-a668-5318143409d7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1093 microversion: 2.1 time: 0.070325 Aug 18 17:20:55.924709 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 391/762] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:55 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:56.276031 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:56.278177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:56.285987 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:56.287326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:56.287952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:56.288719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:56.289185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:56.289614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:56.440078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:56.452289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a2b7cedb-38ae-4b60-a9a6-ff3f3eb4cf21 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1519 microversion: 2.1 time: 0.179138 Aug 18 17:20:56.452289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 372/763] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:56 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:56.953425 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:56.955557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:56.960692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:56.965048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:56.965622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:56.966144 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:56.966956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:56.967674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:56.968307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:57.063199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:57.073683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7ebc199a-3a63-4784-b846-c8443488e350 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1135 microversion: 2.1 time: 0.132061 Aug 18 17:20:57.075011 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 392/764] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:56 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1135 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:57.474856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:57.475628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:57.483588 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:57.484368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:57.484979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:57.486189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:57.486805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:57.487420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:57.658830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:57.667624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9e797f64-2aa1-4d6a-9f0d-f47a555fb1e5 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.197979 Aug 18 17:20:57.668190 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 373/765] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:57 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:57.726734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fa558f92-9f51-4a5e-be9a-965f934af1db tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: .version_select at 0x7fd1fb5b5e50>, body: {"keypair": {"name": "tempest-keypair-1314215007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBngabZzNyiHUvDZcTN0ohkg+uto96zabUZznsTtm7mimqEM+U8fBLX8f6NSL8Cg10+FWzIMjI8ZD3EBLGpwo7BQHOx7YyByTPVIU3hZA59gauoS45wiIL3heEs31ilUQ=="}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:20:57.743291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-fa558f92-9f51-4a5e-be9a-965f934af1db tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for project b531205569ec466f8e1ce8ce05427663. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:20:57.750288 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-fa558f92-9f51-4a5e-be9a-965f934af1db tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for user c5796bbaaf1345b6867d3cd5082f75b0 and project b531205569ec466f8e1ce8ce05427663. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:20:57.837742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fa558f92-9f51-4a5e-be9a-965f934af1db tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170890 Aug 18 17:20:57.851340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 393/766] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:20:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:20:58.101424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:58.101959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:58.115202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:58.116164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:58.116782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:58.118167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:58.118779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:58.119416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:58.256531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:58.274000 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ac4eb39f-0b66-4212-be9b-4b9886ef4334 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1209 microversion: 2.1 time: 0.176608 Aug 18 17:20:58.275128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 374/767] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:58 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:58.690096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:58.690717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:58.701850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:58.702340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:58.702769 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:58.703543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:58.704276 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:58.704708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:59.139455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:59.149100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-55cbad95-cf7d-447e-a73c-2f4693821980 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.463977 Aug 18 17:20:59.150047 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 394/768] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:58 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:20:59.297757 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:20:59.302689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:20:59.302689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:59.309695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:59.310256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:59.310784 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:59.313749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:20:59.314636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:20:59.315330 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:20:59.648750 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:20:59.657274 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3e8d0ebf-b11c-42c8-b4df-c2cbde79f2c4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1277 microversion: 2.1 time: 0.363561 Aug 18 17:20:59.657846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 375/769] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:20:59 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:00.173226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:00.174670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:00.183516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:00.184077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:00.184719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:00.185626 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:00.186289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:00.186777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:00.460886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:00.472299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a43a0b1a-f696-459e-8469-20ac25498770 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.305074 Aug 18 17:21:00.486890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 395/770] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:00 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:00.497480 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-171937418", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f95bd5cc-1184-4613-8f77-dbd0ddb9712a"}], "security_groups": [{"name": "tempest-securitygroup--685314094"}], "key_name": "tempest-keypair-1314215007", "user_data": "}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:00.661803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] validate_networks() for [('f95bd5cc-1184-4613-8f77-dbd0ddb9712a', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:21:00.677828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:00.678512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:00.685264 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:00.685814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:00.686314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:00.687283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:00.687973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:00.688523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:01.015950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:01.024893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-173843cf-07ba-49bc-9252-06aa09536fa1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.351129 Aug 18 17:21:01.025690 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 396/771] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:00 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:21:01.311627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-0d1bd812-76e3-436a-afa6-c2f25e6e0d08 req-20489833-f318-461d-8102-58aa4f2592f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0f71e4-16c3-46fb-9f83-612c29210afb", "tag": "908c5bf5-4e23-4b54-a0e1-d6557f5c1217"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:01.327225 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-0d1bd812-76e3-436a-afa6-c2f25e6e0d08 req-20489833-f318-461d-8102-58aa4f2592f9 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:01.327736 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-0d1bd812-76e3-436a-afa6-c2f25e6e0d08 req-20489833-f318-461d-8102-58aa4f2592f9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:01.328196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-0d1bd812-76e3-436a-afa6-c2f25e6e0d08 req-20489833-f318-461d-8102-58aa4f2592f9 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:01.340682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-0d1bd812-76e3-436a-afa6-c2f25e6e0d08 req-20489833-f318-461d-8102-58aa4f2592f9 service nova] Creating event network-changed:908c5bf5-4e23-4b54-a0e1-d6557f5c1217 for instance 9e0f71e4-16c3-46fb-9f83-612c29210afb on hv-cinder-85367 Aug 18 17:21:01.346059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-0d1bd812-76e3-436a-afa6-c2f25e6e0d08 req-20489833-f318-461d-8102-58aa4f2592f9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038739 Aug 18 17:21:01.346774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 397/772] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:01.431295 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:21:01.431763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:21:01.432319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:21:01.432736 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:21:01.433157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:21:01.443291 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:01.443997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:01.444437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:01.445172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:01.445631 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:01.446052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:01.465108 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for project b531205569ec466f8e1ce8ce05427663. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:21:01.469343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for user c5796bbaaf1345b6867d3cd5082f75b0 and project b531205569ec466f8e1ce8ce05427663. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:21:01.481584 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:21:01.483812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:21:01.495185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:01.496747 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:01.504314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:01.506785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:01.507756 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:01.508729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:01.509395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:01.510036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:01.582177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-95e3b4ab-a740-4271-9407-d2896b506f64 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.103723 Aug 18 17:21:01.584332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 376/773] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:21:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:21:01.595460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a92c2bda-0879-4263-b7c0-681b5172bceb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:01.598168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a92c2bda-0879-4263-b7c0-681b5172bceb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:01.702740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a92c2bda-0879-4263-b7c0-681b5172bceb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:01.712066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a92c2bda-0879-4263-b7c0-681b5172bceb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1237 microversion: 2.1 time: 0.120423 Aug 18 17:21:01.718098 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 377/774] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:01 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:01.775084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:01.793493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8754a0ad-2a96-4b3c-b6fb-298de68fea35 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.303502 Aug 18 17:21:01.797729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 398/775] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:01 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:02.045726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:02.046465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:02.053497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:02.053974 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:02.054432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:02.060768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:02.060768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:02.060768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:02.286717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:02.295742 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-85a0fb93-20d0-4815-a9f3-e07a70d71638 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.254037 Aug 18 17:21:02.296326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 378/776] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:02 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:02.733612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:02.734134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:02.740722 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:02.741195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:02.741666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:02.742350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:02.742799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:02.743248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:02.745871 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:02.807061 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:02.816071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a62a3161-7dba-4780-ab69-69475931f6e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1241 microversion: 2.1 time: 0.086496 Aug 18 17:21:02.816630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 399/777] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:02 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:02.819538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:02.820156 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:02.826702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:02.827214 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:02.827647 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:02.828409 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:02.828856 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:02.829474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:02.844802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:02.962099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:02.969595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8e0a2755-9d0b-471e-bf73-3f32461d1d14 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.154639 Aug 18 17:21:02.970163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 379/778] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:02 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:21:03.317180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:03.318341 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:03.325077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:03.325558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:03.325986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:03.326670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:03.327146 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:03.327574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:03.461263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:03.469239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-60eb6a3c-56b2-4f46-82c5-7c36e23140ef tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.156251 Aug 18 17:21:03.470000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 400/779] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:03 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:03.837020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:03.837621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:03.844729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:03.845210 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:03.845676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:03.846373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:03.846823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:03.847270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:03.912241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:03.919977 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-43cb00dc-6e87-4dcd-84ef-d555d6aad6c6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1233 microversion: 2.1 time: 0.086931 Aug 18 17:21:03.920556 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 380/780] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:03 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:03.989981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:03.990637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:04.001968 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:04.001968 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:04.001968 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:04.001968 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:04.002282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:04.002282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:04.138463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:04.147165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dce3e632-c8a3-4145-8f6c-1e430cb06dec tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.161072 Aug 18 17:21:04.147728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 401/781] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:03 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:04.491530 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:04.492285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:04.498147 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:04.499313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:04.499313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:04.499812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:04.500260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:04.500688 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:04.716718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:04.725529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6a405ac4-1156-474e-9e2e-3c8e0ceaee86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.238680 Aug 18 17:21:04.726201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 381/782] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:04 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:04.940623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:04.941387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:04.948325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:04.948808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:04.949338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:04.949991 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:04.950447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:04.950872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:05.035825 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:05.044232 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a39ab10f-9b15-4a8c-839a-3608e907d404 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1295 microversion: 2.1 time: 0.107631 Aug 18 17:21:05.044796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 402/783] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:04 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:05.168261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:05.168873 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:05.175260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:05.175739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:05.176174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:05.177523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:05.178294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:05.178779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:05.375209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:05.383648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-682a3109-dd98-4c3f-980b-9e9f9a88b156 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.219412 Aug 18 17:21:05.384255 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 382/784] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:05 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:05.746550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:05.747193 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:05.753155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:05.753624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:05.754047 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:05.754724 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:05.755893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:05.756347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:05.889951 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:05.897728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b0b9c595-5757-4145-9c52-c24dc71b059b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.155083 Aug 18 17:21:05.898298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 403/785] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:05 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:06.065791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:06.066408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:06.072534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:06.073016 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:06.073459 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:06.074157 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:06.074616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:06.075090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:06.203073 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:06.211549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7e263b19-9432-4713-9ac4-92420cdd819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.149961 Aug 18 17:21:06.212116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 383/786] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:06 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:06.404329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:06.404970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:06.411466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:06.412114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:06.412592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:06.413343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:06.413808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:06.414208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:06.604032 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:06.611957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-53580b74-2515-42a0-8a79-9da96aec9c2c tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.211612 Aug 18 17:21:06.612749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 404/787] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:06 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:06.918252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:06.922597 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:06.925490 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:06.925969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:06.926403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:06.927249 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:06.927939 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:06.928398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:07.015423 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-40bf0e2c-a7fa-4a30-ba72-45e136064d10 req-ac3080f2-cfde-4906-8793-3e89aebd9922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25511a4-8386-4e28-af43-fd634d160293", "tag": "f2d34da6-7a98-4f76-8518-486441b45056"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:07.027598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-40bf0e2c-a7fa-4a30-ba72-45e136064d10 req-ac3080f2-cfde-4906-8793-3e89aebd9922 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:07.028138 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-40bf0e2c-a7fa-4a30-ba72-45e136064d10 req-ac3080f2-cfde-4906-8793-3e89aebd9922 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:07.028762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-40bf0e2c-a7fa-4a30-ba72-45e136064d10 req-ac3080f2-cfde-4906-8793-3e89aebd9922 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:07.042115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-40bf0e2c-a7fa-4a30-ba72-45e136064d10 req-ac3080f2-cfde-4906-8793-3e89aebd9922 service nova] Creating event network-changed:f2d34da6-7a98-4f76-8518-486441b45056 for instance f25511a4-8386-4e28-af43-fd634d160293 on hv-cinder-85367 Aug 18 17:21:07.047571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-40bf0e2c-a7fa-4a30-ba72-45e136064d10 req-ac3080f2-cfde-4906-8793-3e89aebd9922 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036577 Aug 18 17:21:07.048700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 405/788] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:07.158668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:07.166539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-64f215bf-22b5-4b67-98f5-cd4c82a90400 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.252172 Aug 18 17:21:07.167357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 384/789] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:06 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:07.233047 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:07.233754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:07.240587 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:07.241293 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:07.241738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:07.242443 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:07.243096 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:07.243527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:07.635336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:07.635958 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:07.642629 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:07.643156 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:07.643799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:07.649758 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:07.649758 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:07.649758 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:07.687680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:07.696553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cb6742fc-4de4-4dd1-ba2c-d29880295373 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.467681 Aug 18 17:21:07.697501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 406/790] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:07 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:07.891502 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:07.900214 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cfb6e418-bbca-4069-97dc-1d86ee759676 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.268674 Aug 18 17:21:07.900762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 385/791] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:07 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:08.188278 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:08.188950 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:08.191165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=10 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:08.196062 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:08.196544 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:08.196982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:08.197675 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:08.198132 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:08.198592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:08.332641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:08.340308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-eebc34d9-146c-40c9-8698-95c1b04553ac tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.155931 Aug 18 17:21:08.340863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 407/792] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:08 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:08.717599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:08.718162 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:08.725493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:08.725976 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:08.726413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:08.727161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:08.727616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:08.728050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:08.873884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:08.882540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-daebf3a2-03b9-497f-84e2-26ced619d76f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.168747 Aug 18 17:21:08.883146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 386/793] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:08 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:08.921656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:08.922275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:08.929051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:08.929518 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:08.929938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:08.930617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:08.931102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:08.931522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:09.066131 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:09.074745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2c731809-bdf9-4383-a9c9-d3c498168d7b tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.157033 Aug 18 17:21:09.075411 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 408/794] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:08 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:09.115553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-9f84ce49-5b0e-4e75-bf49-1a0ee8b8a0ba req-449700b8-c501-49ef-adf3-def89b2dc2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "name": "network-vif-plugged", "status": "completed", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:09.125011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9f84ce49-5b0e-4e75-bf49-1a0ee8b8a0ba req-449700b8-c501-49ef-adf3-def89b2dc2c1 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:09.125560 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9f84ce49-5b0e-4e75-bf49-1a0ee8b8a0ba req-449700b8-c501-49ef-adf3-def89b2dc2c1 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:09.125984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-9f84ce49-5b0e-4e75-bf49-1a0ee8b8a0ba req-449700b8-c501-49ef-adf3-def89b2dc2c1 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:09.137623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-9f84ce49-5b0e-4e75-bf49-1a0ee8b8a0ba req-449700b8-c501-49ef-adf3-def89b2dc2c1 service nova] Creating event network-vif-plugged:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:21:09.143019 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-9f84ce49-5b0e-4e75-bf49-1a0ee8b8a0ba req-449700b8-c501-49ef-adf3-def89b2dc2c1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031168 Aug 18 17:21:09.143624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 387/795] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:09.361491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:09.362121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:09.368320 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:09.368799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:09.369234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:09.369920 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:09.370369 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:09.370794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:09.502488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:09.513086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9ee9e915-5d87-4f6b-a2a3-876897f6758f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.155441 Aug 18 17:21:09.513707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 409/796] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:09 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:09.903541 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:09.904229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:09.910710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:09.911266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:09.912009 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:09.912705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:09.913981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:09.914418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:10.045864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:10.054275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-125f130b-b378-4960-99a0-6ebe5de55898 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.154933 Aug 18 17:21:10.054837 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 388/797] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:09 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:10.097033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:10.097637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:10.104110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:10.104589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:10.105018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:10.105705 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:10.106163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:10.106585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:10.242796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:10.250439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-15143f75-5eb3-465d-8d26-61109e196dc9 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.157425 Aug 18 17:21:10.251021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 410/798] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:10 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:10.534101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:10.534717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:10.541400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:10.541878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:10.542312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:10.543024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:10.543475 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:10.543896 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:10.675840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:10.684177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b02b1213-9a31-4885-b4fb-6ba18dd7de4b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.153976 Aug 18 17:21:10.684756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 389/799] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:10 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:11.075891 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:11.076585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:11.082617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:11.083166 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:11.086428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:11.086428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:11.086428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:11.086428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:11.220263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:11.228872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-48f48b6d-0e01-4554-85d5-e871de413a5e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.156847 Aug 18 17:21:11.229476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 411/800] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:11 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:11.272484 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:11.273183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:11.279313 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:11.279798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:11.280241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:11.280964 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:11.281420 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:11.281850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:11.416430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:11.424033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3b8a2ba3-93ea-4d9f-9802-a371240421e4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.155634 Aug 18 17:21:11.424595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 390/801] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:11 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:11.705614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:11.706226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:11.712612 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:11.713091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:11.713522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:11.714266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:11.714725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:11.716000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:11.861532 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:11.870738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-293dfdd5-6797-4831-aa0c-bb8d78b5977a tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.168996 Aug 18 17:21:11.871402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 412/802] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:11 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:12.250193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:12.254974 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:12.257637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=4 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:12.258338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=14 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:12.264094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:12.264574 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:12.265006 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:12.265698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:12.266147 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:12.266566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:12.396646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:12.404309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-20189aa4-fe05-422b-ad9c-51ec22ee5b77 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.158190 Aug 18 17:21:12.404808 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 391/803] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:12 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:12.446542 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:12.447235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:12.453454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:12.453925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:12.454348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:12.455061 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:12.455505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:12.455920 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:12.595762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:12.604357 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d6eb2280-9e5d-4dae-9a60-a4b389ef679f tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.162404 Aug 18 17:21:12.604925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 413/804] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:12 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:12.892875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:12.893493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:12.899863 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:12.900340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:12.900778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:12.901469 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:12.901920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:12.902337 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:13.035301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:13.043936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a7a9bc45-9516-42bd-a1a0-9c34ba31a7a1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.154963 Aug 18 17:21:13.044739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 392/805] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:12 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:13.425447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:13.426055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:13.428498 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-8edde0f4-727b-4770-851e-e1f1012e04c2 req-12c5b91c-719e-4122-a6d2-c0546ce32966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25511a4-8386-4e28-af43-fd634d160293", "name": "network-vif-plugged", "status": "completed", "tag": "f2d34da6-7a98-4f76-8518-486441b45056"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:13.432998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:13.433481 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:13.433912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:13.434602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:13.435082 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:13.435561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:13.439411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-8edde0f4-727b-4770-851e-e1f1012e04c2 req-12c5b91c-719e-4122-a6d2-c0546ce32966 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:13.439892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-8edde0f4-727b-4770-851e-e1f1012e04c2 req-12c5b91c-719e-4122-a6d2-c0546ce32966 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:13.440349 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-8edde0f4-727b-4770-851e-e1f1012e04c2 req-12c5b91c-719e-4122-a6d2-c0546ce32966 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:13.452962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-8edde0f4-727b-4770-851e-e1f1012e04c2 req-12c5b91c-719e-4122-a6d2-c0546ce32966 service nova] Creating event network-vif-plugged:f2d34da6-7a98-4f76-8518-486441b45056 for instance f25511a4-8386-4e28-af43-fd634d160293 on hv-cinder-85367 Aug 18 17:21:13.457937 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-8edde0f4-727b-4770-851e-e1f1012e04c2 req-12c5b91c-719e-4122-a6d2-c0546ce32966 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033996 Aug 18 17:21:13.459119 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 393/806] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:21:13.569292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:13.576919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-380ab773-a924-4478-b24f-9f23725665c0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.155768 Aug 18 17:21:13.577481 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 414/807] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:13 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:13.626191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:13.626879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:13.633765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:13.634248 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:13.634689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:13.635457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:13.635916 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:13.636340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:13.777325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:13.785483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-25872e84-69af-4d51-87b2-35a02b3ff1b0 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1575 microversion: 2.1 time: 0.163484 Aug 18 17:21:13.786845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 394/808] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:13 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:14.064717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:14.065431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:14.072421 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:14.072905 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:14.073337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:14.074026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:14.074472 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:14.074886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:14.206943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:14.215667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-332efd00-cf1e-4929-89bf-51aae791e165 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.154951 Aug 18 17:21:14.216216 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 415/809] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:14 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:14.598111 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:14.598741 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:14.605914 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:14.606388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:14.606816 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:14.607523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:14.607969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:14.608394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:14.735504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:14.743296 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-42668f18-0ac3-4fd0-a899-3e6d81026a83 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.149050 Aug 18 17:21:14.743983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 395/810] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:14 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:14.807225 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:14.807869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:14.814540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:14.815056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:14.815493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:14.816188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:14.816643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:14.817068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:14.832183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=100 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:14.946325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:14.954010 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f3cf21d7-804e-4839-a065-26346c3f9c74 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1562 microversion: 2.1 time: 0.150725 Aug 18 17:21:14.954566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 416/811] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:14 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:15.239828 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:15.240484 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:15.246368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:15.246847 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:15.247309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:15.247997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:15.248452 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:15.248876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:15.387325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:15.395155 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c9772288-91de-456e-aab9-3b9233a623af tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.159826 Aug 18 17:21:15.396223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 396/812] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:15 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:15.479778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-4c13f8fc-b17a-4600-8707-07234bec4e72 req-8cdf3f20-7186-4d38-b22e-b244f5dc4a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0f71e4-16c3-46fb-9f83-612c29210afb", "name": "network-vif-plugged", "status": "completed", "tag": "908c5bf5-4e23-4b54-a0e1-d6557f5c1217"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:15.489212 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-4c13f8fc-b17a-4600-8707-07234bec4e72 req-8cdf3f20-7186-4d38-b22e-b244f5dc4a6e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:15.489980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-4c13f8fc-b17a-4600-8707-07234bec4e72 req-8cdf3f20-7186-4d38-b22e-b244f5dc4a6e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:15.490554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-4c13f8fc-b17a-4600-8707-07234bec4e72 req-8cdf3f20-7186-4d38-b22e-b244f5dc4a6e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:15.501961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-4c13f8fc-b17a-4600-8707-07234bec4e72 req-8cdf3f20-7186-4d38-b22e-b244f5dc4a6e service nova] Creating event network-vif-plugged:908c5bf5-4e23-4b54-a0e1-d6557f5c1217 for instance 9e0f71e4-16c3-46fb-9f83-612c29210afb on hv-cinder-85367 Aug 18 17:21:15.508224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-4c13f8fc-b17a-4600-8707-07234bec4e72 req-8cdf3f20-7186-4d38-b22e-b244f5dc4a6e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Aug 18 17:21:15.508834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 417/813] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:15.764294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:15.764913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:15.772212 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:15.772695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:15.773130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:15.773830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:15.774284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:15.774706 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:15.790172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=100 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:15.903435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:15.911044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-740b0371-ce36-49e4-b153-115a54947cf9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1362 microversion: 2.1 time: 0.150720 Aug 18 17:21:15.911674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 397/814] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:15 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:16.418065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:16.418760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:16.425407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:16.425887 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:16.426317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:16.427738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:16.428191 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:16.428617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:16.556743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:16.564710 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5d0b2473-cdbd-4199-aced-2f58146e2561 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.150632 Aug 18 17:21:16.565274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 418/815] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:16 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:21:16.932394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:16.933025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:16.939885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:16.940370 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:16.940802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:16.941499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:16.941949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:16.942455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:17.072311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:17.079932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-544217c2-f017-44de-88e4-c4da6c608699 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1548 microversion: 2.1 time: 0.151456 Aug 18 17:21:17.080493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 398/816] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:16 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:17.100094 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:17.100577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:17.106386 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:17.106855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:17.107310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:17.107988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:17.108433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:17.108849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:17.186387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e22e4bdc-9cdb-43ee-bf5e-c1015f6bc647 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090585 Aug 18 17:21:17.186994 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 419/817] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:21:17 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:17.586480 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:17.587135 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:17.593167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:17.594512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:17.595400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:17.596586 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:17.597123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:17.597973 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:17.752459 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:17.760377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-af68236c-3b73-40b1-8e4f-ece3f8168efc tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1265 microversion: 2.1 time: 0.178376 Aug 18 17:21:17.760936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 399/818] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:17 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:18.235963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-0d2dfc7d-946f-4d46-a758-9e08706af9d9 req-441f3116-f393-49f8-8f6a-6f5ef7eb3894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25511a4-8386-4e28-af43-fd634d160293", "tag": "f2d34da6-7a98-4f76-8518-486441b45056"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:18.246337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-0d2dfc7d-946f-4d46-a758-9e08706af9d9 req-441f3116-f393-49f8-8f6a-6f5ef7eb3894 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:18.246819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-0d2dfc7d-946f-4d46-a758-9e08706af9d9 req-441f3116-f393-49f8-8f6a-6f5ef7eb3894 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:18.247278 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-0d2dfc7d-946f-4d46-a758-9e08706af9d9 req-441f3116-f393-49f8-8f6a-6f5ef7eb3894 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:18.259100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-0d2dfc7d-946f-4d46-a758-9e08706af9d9 req-441f3116-f393-49f8-8f6a-6f5ef7eb3894 service nova] Creating event network-changed:f2d34da6-7a98-4f76-8518-486441b45056 for instance f25511a4-8386-4e28-af43-fd634d160293 on hv-cinder-85367 Aug 18 17:21:18.264969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-0d2dfc7d-946f-4d46-a758-9e08706af9d9 req-441f3116-f393-49f8-8f6a-6f5ef7eb3894 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033222 Aug 18 17:21:18.265576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 420/819] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:18.781581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:18.782845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:18.789786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:18.790270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:18.790707 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:18.791432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:18.791883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:18.792324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:18.926694 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:18.935370 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-68a11ca0-b28b-452e-ae0c-8484bc0518be tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1451 microversion: 2.1 time: 0.157498 Aug 18 17:21:18.935957 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 400/820] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:18 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:21:18.957310 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:18.958019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:18.965275 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:18.965763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:18.966196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:18.966925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:18.967371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:18.967795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:19.109717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:19.118065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-132b174c-9b4e-4eae-9d82-ded68bc25099 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1451 microversion: 2.1 time: 0.164945 Aug 18 17:21:19.118648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 421/821] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:21:18 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:21:21.221770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-848e5c9c-51bd-464b-8b85-6b309e4cee4b req-23c71d00-0592-4a61-bef1-cd3f1b8e804e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0f71e4-16c3-46fb-9f83-612c29210afb", "tag": "908c5bf5-4e23-4b54-a0e1-d6557f5c1217"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:21.231514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-848e5c9c-51bd-464b-8b85-6b309e4cee4b req-23c71d00-0592-4a61-bef1-cd3f1b8e804e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:21.231985 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-848e5c9c-51bd-464b-8b85-6b309e4cee4b req-23c71d00-0592-4a61-bef1-cd3f1b8e804e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:21.232413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-848e5c9c-51bd-464b-8b85-6b309e4cee4b req-23c71d00-0592-4a61-bef1-cd3f1b8e804e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:21.244131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-848e5c9c-51bd-464b-8b85-6b309e4cee4b req-23c71d00-0592-4a61-bef1-cd3f1b8e804e service nova] Creating event network-changed:908c5bf5-4e23-4b54-a0e1-d6557f5c1217 for instance 9e0f71e4-16c3-46fb-9f83-612c29210afb on hv-cinder-85367 Aug 18 17:21:21.249069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-848e5c9c-51bd-464b-8b85-6b309e4cee4b req-23c71d00-0592-4a61-bef1-cd3f1b8e804e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030874 Aug 18 17:21:21.249677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 401/822] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:21:48.799875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:48.800940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:48.802880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:48.803616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=23 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:48.808312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:48.808787 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:48.809223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:48.809939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:48.810510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:48.810953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:48.833761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0dbb2b72-3da5-4b66-a557-a513254b413f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/ips" status: 200 len: 151 microversion: 2.20 time: 0.037864 Aug 18 17:21:48.834316 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 422/823] 10.222.0.82 () {60 vars in 1289 bytes} [Thu Aug 18 17:21:48 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:21:52.038915 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:52.039672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=23 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:52.043901 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:21:52.044516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:52.051251 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:52.051738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:52.052168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:52.052864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:52.053315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:52.053737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:52.076802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lazy-loading 'flavor' on Instance uuid 9b3a9074-980b-4900-941f-59ac5d780fef {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:21:52.459824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a024031d-6dca-4d84-ab27-3e6295510f90 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/action" status: 202 len: 0 microversion: 2.20 time: 0.422547 Aug 18 17:21:52.460657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 402/824] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 17:21:52 2022] POST /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:21:52.469822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:52.470508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:52.478106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:52.478593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:52.479070 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:52.479775 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:52.480233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:52.480674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:52.614843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:52.623091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:52.624604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:52.625889 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c15115e3-86e4-4ee3-b20a-67b43d0f09b5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.161171 Aug 18 17:21:52.626447 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 423/825] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:52 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:21:53.650425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:53.651176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:53.658560 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:53.659070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:53.659521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:53.660191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:53.660638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:53.661105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:53.790222 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:53.798972 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:53.800472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:53.801616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-09b72f60-2222-4b1a-9477-32e6d71d9939 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.156046 Aug 18 17:21:53.802174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 403/826] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:53 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:21:54.825226 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:54.825828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:54.831966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:54.832442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:54.832872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:54.833557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:54.834012 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:54.834436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:54.965658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:54.974186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:54.975718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:54.976864 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cc386c84-6aab-4f5e-be7f-9673cc635ae0 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.155738 Aug 18 17:21:54.977413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 424/827] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:54 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:21:55.999981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:56.000776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:56.007916 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:56.008389 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:56.008821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:56.009521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:56.009974 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:56.010400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:56.139375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:56.147680 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:56.149180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:56.150325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-aad49182-5928-4825-b03e-f29e9b2ea21f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.154347 Aug 18 17:21:56.150891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 404/828] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:55 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:21:57.173340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:57.173941 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:57.180303 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:57.180778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:57.181204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:57.181883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:57.182329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:57.182761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:57.312942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:57.322150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:57.323698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:57.324856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cf312c84-f6c7-4325-b968-0277b4419e9e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.155816 Aug 18 17:21:57.325415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 425/829] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:57 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:21:58.348184 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:58.348799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:58.354748 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:58.355276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:58.355719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:58.356407 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:58.356893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:58.357320 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:58.491692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:58.499951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:58.501449 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:58.502604 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-79d03245-c60a-4a14-b053-f935533bfe74 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.158597 Aug 18 17:21:58.503204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 405/830] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:58 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:21:59.525653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:21:59.526602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:21:59.533315 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:59.533782 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:59.534208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:59.534907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:21:59.535364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:21:59.535780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:21:59.664576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:59.674116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:59.675763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:21:59.676971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-652a1e42-601c-40a7-8e5c-043157aa448b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.155222 Aug 18 17:21:59.677541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 426/831] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:21:59 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:00.700853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:00.701381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:00.707912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:00.708418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:00.708852 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:00.709548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:00.709999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:00.710422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:00.841967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:00.850477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:00.852020 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:00.853208 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-09a9825c-e40d-4f5c-a19c-379257ed707e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.156301 Aug 18 17:22:00.853771 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 406/832] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:00 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:01.878499 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:01.879060 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:01.885510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:01.885979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:01.886403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:01.887117 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:01.887564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:01.887985 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:02.019838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:02.027885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:02.029537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:02.030812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-53429aa5-2099-4d7d-97c4-bd8359932d01 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.156630 Aug 18 17:22:02.032036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 427/833] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:01 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:03.054163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:03.054775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:03.061258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:03.061739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:03.062173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:03.062866 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:03.063340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:03.063763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:03.194708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:03.202713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:03.204352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:03.205514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a575debf-3346-4c45-b3b9-5306a2f68213 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.155285 Aug 18 17:22:03.206077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 407/834] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:03 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:04.228098 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:04.228703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:04.236077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:04.236588 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:04.237018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:04.237700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:04.238146 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:04.238565 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:04.365745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:04.373891 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:04.376525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:04.377682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-36e89fd3-5612-45ef-a514-d366061a5c1c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1743 microversion: 2.20 time: 0.153474 Aug 18 17:22:04.378238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 428/835] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:04 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:05.401151 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:05.401775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:05.408764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:05.409248 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:05.409683 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:05.410385 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:05.410843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:05.411349 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:05.541501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:05.551357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:05.553644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:05.554148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8bbab33f-9db8-4afc-a11d-73b3fe06a90a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1743 microversion: 2.20 time: 0.157009 Aug 18 17:22:05.554720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 408/836] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:05 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:22:06.576669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:06.577257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:06.584187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:06.584662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:06.585089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:06.585767 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:06.586208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:06.586625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:06.718278 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:06.727047 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:06.728531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:06.729666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f344b93c-e68d-4a44-b0bc-04f48a449a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1743 microversion: 2.20 time: 0.156889 Aug 18 17:22:06.730215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 429/837] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:06 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:07.443999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-6d9c86cc-8e85-4447-96d7-253723d5c379 req-0204e138-a797-4b17-bd97-62ad6a337590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "name": "network-vif-plugged", "status": "completed", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:07.453752 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-6d9c86cc-8e85-4447-96d7-253723d5c379 req-0204e138-a797-4b17-bd97-62ad6a337590 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:07.454217 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-6d9c86cc-8e85-4447-96d7-253723d5c379 req-0204e138-a797-4b17-bd97-62ad6a337590 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:07.454639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-6d9c86cc-8e85-4447-96d7-253723d5c379 req-0204e138-a797-4b17-bd97-62ad6a337590 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:07.465667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-6d9c86cc-8e85-4447-96d7-253723d5c379 req-0204e138-a797-4b17-bd97-62ad6a337590 service nova] Creating event network-vif-plugged:5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e for instance 9b3a9074-980b-4900-941f-59ac5d780fef on hv-cinder-85367 Aug 18 17:22:07.471402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-6d9c86cc-8e85-4447-96d7-253723d5c379 req-0204e138-a797-4b17-bd97-62ad6a337590 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 Aug 18 17:22:07.471997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 409/838] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:22:07.753680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:07.754184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:07.760589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:07.761071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:07.761514 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:07.762207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:07.762666 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:07.763119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:07.892680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:07.900686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:07.902195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:07.903436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-26d724b6-8547-4f7c-a3aa-ddb7778f71d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1743 microversion: 2.20 time: 0.154043 Aug 18 17:22:07.903988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 430/839] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:07 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:08.927279 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:08.927975 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:08.934005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:08.937007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:08.937007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:08.937007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:08.937007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:08.937886 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:09.070463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:09.079035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:09.080537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:09.081674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dc5726d9-d79e-48e5-81ad-196df17b1b62 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1743 microversion: 2.20 time: 0.159350 Aug 18 17:22:09.082255 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 410/840] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:08 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:10.104563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:10.105170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:10.111940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:10.112424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:10.112857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:10.113600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:10.114070 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:10.114477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:10.243160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:10.253577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:10.255575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:10.257185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f5f94ea9-083a-4d83-b8dd-5d3616dcece2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1743 microversion: 2.20 time: 0.156373 Aug 18 17:22:10.257949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 431/841] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:10 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:11.280040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:11.280559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:11.286989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:11.287466 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:11.287920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:11.288591 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:11.289044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:11.289463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:11.422724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:11.432226 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:11.433833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:11.435022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a25de327-4a73-4e01-8956-34f6d67b1c26 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.158888 Aug 18 17:22:11.435589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 411/842] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:11 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:12.459424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:12.460697 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:12.467606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:12.468085 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:12.468517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:12.469246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:12.469809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:12.470267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:12.613026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:12.621308 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:12.622812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:12.624025 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-bbd3cdaa-6b5a-4cfb-bb5f-e194a5929f5e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.168606 Aug 18 17:22:12.624577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 432/843] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:12 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:13.650023 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:13.650891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:13.659044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:13.659833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:13.660479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:13.661375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:13.662107 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:13.663599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:13.841831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:13.855895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:13.858484 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:13.859169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-942fc31d-5e78-40d4-a263-62d244128916 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.215376 Aug 18 17:22:13.860278 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 412/844] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:13 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:14.886703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:14.887401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:14.895373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:14.895803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:14.896466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:14.897218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:14.897652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:14.898075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:15.053553 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:15.061659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:15.063785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:15.065205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3b08ad3d-68cd-4d62-8a29-79a144a0f07d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.182443 Aug 18 17:22:15.065777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 433/845] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:14 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:16.092485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:16.093076 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:16.101432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:16.102254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:16.102976 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:16.103858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:16.104555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:16.105022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:16.241458 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:16.250779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:16.252359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:16.253508 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-058c7c8d-0f9d-467f-8b49-ef0fe32f54e2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.165669 Aug 18 17:22:16.254064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 413/846] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:16 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:17.277368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:17.278051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:17.285056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:17.285537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:17.285975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:17.286935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:17.287403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:17.287828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:17.434492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:17.444099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:17.445597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:17.446876 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4f85b59a-c975-432f-b9c9-60137a9fc048 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.173475 Aug 18 17:22:17.447353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 434/847] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:17 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:18.469473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:18.470214 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:18.477953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:18.478872 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:18.479336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:18.480043 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:18.480500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:18.480931 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:18.637087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:18.646545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:18.648334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:18.649477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-833f96ae-0e97-4b50-83b8-74dbf982ef41 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.184067 Aug 18 17:22:18.650047 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 414/848] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:18 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:19.676270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:19.676982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:19.684307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:19.684856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:19.685485 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:19.686240 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:19.686692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:19.687140 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:19.830148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:19.838710 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:19.840266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:19.841545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a44b9b9e-ff6e-487e-8fce-946cfbe856a1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.169698 Aug 18 17:22:19.842402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 435/849] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:19 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:20.866396 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:20.867001 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:20.873473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:20.874075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:20.874598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:20.875442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:20.875956 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:20.876979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:21.083391 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:21.091941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:21.093461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:21.094616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-503ba5a9-1ccc-4c47-9efe-9ec08ed1b58f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.232449 Aug 18 17:22:21.110388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 415/850] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:20 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:22.118452 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:22.119090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:22.126290 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:22.126817 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:22.127581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:22.130592 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:22.131261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:22.131856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:22.344369 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:22.353484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:22.355046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:22.356277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b88a1521-0d42-4e6f-bb25-b32fa6bd6199 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.241905 Aug 18 17:22:22.356847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 436/851] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:22 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:23.380250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:23.381004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:23.384312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=29 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:23.388862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:23.389374 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:23.389952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:23.390669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:23.391178 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:23.391616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:23.394512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:23.537645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:23.545935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:23.547582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:23.548743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-051c91d0-d884-4a39-b815-b8f27d857b35 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.172672 Aug 18 17:22:23.549339 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 416/852] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:23 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:24.571953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:24.572470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:24.574474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=31 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:24.579165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:24.579647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:24.580100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:24.580882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:24.581336 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:24.581762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:24.585639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=89 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:24.711388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:24.719408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:24.721457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:24.722800 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ef96a2f2-fe61-41fe-9723-13e49622e5f5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1738 microversion: 2.20 time: 0.154828 Aug 18 17:22:24.723392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 437/853] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:24 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:25.746171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:25.746709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:25.753805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:25.754283 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:25.754713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:25.755429 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:25.755880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:25.756306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:25.888473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:25.896500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:25.898004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:25.899180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-964f9f57-717c-4546-ba68-80e7f3b16d77 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1720 microversion: 2.20 time: 0.156998 Aug 18 17:22:25.899740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 417/854] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:25 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:26.921907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:26.922510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:26.929265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:26.929738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:26.930165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:26.930869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:26.931340 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:26.931756 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:27.058700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:27.067833 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:27.069330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:27.070480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c229fae4-d1c5-4d88-a617-1863a3f533ef tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1720 microversion: 2.20 time: 0.152503 Aug 18 17:22:27.071088 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 438/855] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:26 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:28.093770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:28.094419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:28.101188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:28.101678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:28.102117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:28.102810 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:28.103294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:28.103723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:28.232455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:28.240631 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:28.242137 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:28.243316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9908dd2c-7b13-4b9d-be98-8d5646d178ba tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1663 microversion: 2.20 time: 0.153470 Aug 18 17:22:28.243872 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 418/856] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:28 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:28.265189 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62bd5f10-5477-48eb-a16c-d95ba1ce8fc3"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:28.268177 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:28.274516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:28.274974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:28.275418 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:28.276106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:28.276558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:28.276983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:29.174956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-380e35e8-2fd4-4ef3-9c03-c751dd69e21d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.913682 Aug 18 17:22:29.175579 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 439/857] 10.222.0.82 () {62 vars in 1364 bytes} [Thu Aug 18 17:22:28 2022] POST /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-volume_attachments => generated 188 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:22:29.297961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:29.298465 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:29.304886 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:29.305359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:29.305788 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:29.306507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:29.306984 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:29.307403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:29.555870 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-55fb9028-2678-4358-bb82-be393ff720d4 req-d47b6a4e-a851-4979-867f-9bf7ad06e732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "name": "network-vif-unplugged", "status": "completed", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:29.569659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-55fb9028-2678-4358-bb82-be393ff720d4 req-d47b6a4e-a851-4979-867f-9bf7ad06e732 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:29.570150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-55fb9028-2678-4358-bb82-be393ff720d4 req-d47b6a4e-a851-4979-867f-9bf7ad06e732 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:29.570563 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-55fb9028-2678-4358-bb82-be393ff720d4 req-d47b6a4e-a851-4979-867f-9bf7ad06e732 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:29.581356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.compute.server_external_events [req-55fb9028-2678-4358-bb82-be393ff720d4 req-d47b6a4e-a851-4979-867f-9bf7ad06e732 service nova] Unable to find a host for instance 9b3a9074-980b-4900-941f-59ac5d780fef. Dropping event network-vif-unplugged {{(pid=121216) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 17:22:29.582249 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-55fb9028-2678-4358-bb82-be393ff720d4 req-d47b6a4e-a851-4979-867f-9bf7ad06e732 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030348 Aug 18 17:22:29.583187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 440/858] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 18 17:22:29.900779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a831c4e1-f621-48d7-a09a-ab19aa4781a7 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-volume_attachments/62bd5f10-5477-48eb-a16c-d95ba1ce8fc3" status: 202 len: 0 microversion: 2.20 time: 0.606670 Aug 18 17:22:29.901365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 419/859] 10.222.0.82 () {60 vars in 1457 bytes} [Thu Aug 18 17:22:29 2022] DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-volume_attachments/62bd5f10-5477-48eb-a16c-d95ba1ce8fc3 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:22:30.079140 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:30.079739 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:30.085773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:30.086257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:30.086700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:30.087487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:30.087941 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:30.088368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:30.130368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121216) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 17:22:30.383606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a98d1056-1439-4ae7-8d6d-d0428379da7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "POST /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/action" status: 202 len: 0 microversion: 2.20 time: 0.426845 Aug 18 17:22:30.384222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 441/860] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 17:22:29 2022] POST /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:22:30.392249 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:30.393423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:30.401534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:30.401534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:30.401534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:30.402006 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:30.402641 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:30.403096 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:30.536796 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:30.545573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:30.548312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:30.549645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-de104eb7-d41f-484b-91ed-a5427588fab5 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1671 microversion: 2.20 time: 0.161091 Aug 18 17:22:30.550445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 420/861] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:30 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:31.573013 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:31.573713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:31.580356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:31.580914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:31.581300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:31.582282 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:31.582735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:31.583184 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:31.713323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:31.721529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:31.724000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:31.725185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b5ec1638-24c7-4b57-af25-b8b0da47f053 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1671 microversion: 2.20 time: 0.156658 Aug 18 17:22:31.725737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 442/862] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:31 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:32.747901 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:32.748512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:32.755201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:32.755686 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:32.756123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:32.756817 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:32.757267 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:32.757689 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:32.926389 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:32.934504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:32.936040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:32.937191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7a36c21c-b7d1-405d-86ba-f792f0b1e22c tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.193144 Aug 18 17:22:32.937747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 421/863] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:32 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:33.959661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:33.960272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:33.966817 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:33.967350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:33.967787 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:33.968512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:33.968967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:33.969434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:34.107307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:34.116614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:34.118251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:34.119505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-84fb7363-8c52-4551-a2d6-cb8d7e53e0b1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.163944 Aug 18 17:22:34.120165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 443/864] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:33 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:35.142022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:35.142678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:35.150529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:35.151061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:35.151496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:35.152198 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:35.152645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:35.153100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:35.286696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:35.296051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:35.297546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:35.299024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-958cfdb8-391d-43f3-b6c2-286e79f77781 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.160872 Aug 18 17:22:35.299800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 422/865] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:35 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:36.322765 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:36.323432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:36.330133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:36.330614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:36.331605 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:36.332306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:36.332761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:36.333199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:36.478478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:36.487349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:36.489029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:36.490204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-53e0a326-a7e7-4a8f-9480-6e9bf4161895 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.171472 Aug 18 17:22:36.490997 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 444/866] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:36 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:37.513624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:37.514524 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:37.522398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:37.522963 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:37.523411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:37.524293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:37.524946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:37.525377 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:37.668680 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:37.677542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:37.679075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:37.680242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-38087d1c-3905-4766-bbf7-ad97f83ce48b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.170594 Aug 18 17:22:37.680991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 423/867] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:37 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:38.704044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:38.704764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:38.711401 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:38.711875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:38.712311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:38.713013 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:38.713466 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:38.713892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:38.853708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:38.863159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:38.865171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:38.866312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8f9fe168-1282-471c-bdea-850d075b247d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.166594 Aug 18 17:22:38.867879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 445/868] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:38 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:39.889534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:39.890147 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:39.897085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:39.897568 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:39.898004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:39.898708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:39.899181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:39.899608 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:40.047531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:40.056850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:40.058376 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:40.059579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-73a406c9-9551-4433-9457-54080227350d tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.174009 Aug 18 17:22:40.065653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 424/869] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:39 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:41.085630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:41.086249 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:41.093377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:41.099391 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:41.099944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:41.100684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:41.101158 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:41.101581 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:41.246989 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:41.255435 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:41.256971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:41.258124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b7b80be1-14b4-4089-9c0e-9ea8a7fed7d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.178650 Aug 18 17:22:41.258681 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 446/870] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:41 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:42.283834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:42.284472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:42.291086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:42.291573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:42.292012 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:42.292709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:42.293167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:42.293645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:42.445549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:42.462647 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:42.464201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:42.465417 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a38a2d94-d86b-4996-9962-f4660bf97511 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.188045 Aug 18 17:22:42.465994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 425/871] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:42 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:43.490187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:43.490802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:43.497221 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:43.497792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:43.498277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:43.498992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:43.499456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:43.499883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:43.631526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:43.639725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:43.641241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:43.642461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-029f8d3f-e73f-4ed2-a1c4-156dc14dcaa2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.157030 Aug 18 17:22:43.643040 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 447/872] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:43 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:44.664923 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:44.665488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:44.671875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:44.672353 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:44.672790 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:44.673484 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:44.673971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:44.674397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:44.803916 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:44.812181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:44.813684 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:44.814831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b9781a60-fec6-41e0-a9ac-f78a4db74eec tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.154096 Aug 18 17:22:44.815675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 426/873] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:44 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:45.838974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:45.839608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:45.845983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:45.846454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:45.846880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:45.848247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:45.848702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:45.849119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:45.978932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:45.986847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:45.988394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:45.989534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9cd21dec-5f3f-4a10-8dbf-1467dc7f7b1b tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.154537 Aug 18 17:22:45.990406 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 448/874] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:45 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:47.012118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:47.012732 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:47.019239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:47.019758 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:47.020192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:47.020881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:47.021334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:47.021757 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:47.150727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:47.161261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:47.164288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:47.166458 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-72af7327-1dae-4c58-bdc8-1701e1526a5a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.157965 Aug 18 17:22:47.167482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 427/875] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:47 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:47.856558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:47.857065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:47.863674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:47.864153 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:47.864585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:47.865279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:47.865729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:47.866147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:47.888992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4ea614b9-9700-43ff-8a32-cc98b98c4d56 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/ips" status: 200 len: 146 microversion: 2.1 time: 0.036282 Aug 18 17:22:47.889551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 449/876] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:22:47 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:22:48.193176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:48.193782 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:48.200298 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:48.200778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:48.201211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:48.201906 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:48.202358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:48.202783 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:48.334007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:48.342131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:48.343659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:48.344804 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f954f305-d936-49f7-ac22-5592551828ad tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.156416 Aug 18 17:22:48.345361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 428/877] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:48 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:49.367404 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:49.378526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:49.378526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:49.378526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:49.378526 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:49.379335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:49.379335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:49.379335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:49.509516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:49.517740 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:49.520001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:49.521248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d203f40f-68c6-441a-a576-a9c1af2f23d2 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.157092 Aug 18 17:22:49.521810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 450/878] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:49 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:50.542956 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:50.543596 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:50.549954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:50.550426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:50.550860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:50.551577 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:50.552025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:50.552449 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:50.678935 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:50.686893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:50.688405 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:50.689534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1a80e8ec-3b88-4d41-8363-c794a59c88fd tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.150522 Aug 18 17:22:50.690370 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 429/879] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:50 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:51.026346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ac94622-9683-4967-9332-a4649470146c"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:51.028826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:51.035157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:51.036762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:51.036762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:51.036762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:51.037988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:51.038397 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:51.043940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:51.580123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3ecf67dc-8283-4274-9bec-799c111112a8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558384 Aug 18 17:22:51.580732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 451/880] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:22:51 2022] POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:22:51.713442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:51.715041 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:51.715247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-411d0b42-8df9-44fb-94f1-c87cce81782a req-2bce8e4d-74c3-4084-9254-f819b0cc31ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "name": "network-vif-plugged", "status": "completed", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:51.723472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:51.729926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:51.729926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:51.729926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:51.729926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:51.730461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:51.730544 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-411d0b42-8df9-44fb-94f1-c87cce81782a req-2bce8e4d-74c3-4084-9254-f819b0cc31ef service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:51.730875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-411d0b42-8df9-44fb-94f1-c87cce81782a req-2bce8e4d-74c3-4084-9254-f819b0cc31ef service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:51.731332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-411d0b42-8df9-44fb-94f1-c87cce81782a req-2bce8e4d-74c3-4084-9254-f819b0cc31ef service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:51.733619 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:51.743830 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-411d0b42-8df9-44fb-94f1-c87cce81782a req-2bce8e4d-74c3-4084-9254-f819b0cc31ef service nova] Creating event network-vif-plugged:5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e for instance 9b3a9074-980b-4900-941f-59ac5d780fef on hv-cinder-85367 Aug 18 17:22:51.748662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-411d0b42-8df9-44fb-94f1-c87cce81782a req-2bce8e4d-74c3-4084-9254-f819b0cc31ef service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038993 Aug 18 17:22:51.749287 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 452/881] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:22:51.881163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:51.889156 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:51.890654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:51.896306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-07db7202-62a3-4cd5-9bf5-a818666d3f02 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.182992 Aug 18 17:22:51.896306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 430/882] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:51 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:52.916464 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:52.917734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:52.924646 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:52.925055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:52.925485 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:52.926175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:52.926620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:52.927072 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:53.060147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:53.069207 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:53.070744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:53.071937 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-171dc2d9-bdb0-484e-bcd8-a2a17b223a7e tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.160272 Aug 18 17:22:53.072530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 453/883] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:52 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:54.095068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:54.095672 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:54.098384 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=30 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:54.103702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:54.104187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:54.104622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:54.105329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:54.105814 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:54.106241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:54.399911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:54.408169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:54.409678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:54.410825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-178c9e73-d581-4462-bc35-c513d0ffb22a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1729 microversion: 2.20 time: 0.319801 Aug 18 17:22:54.411463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 431/884] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:54 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1729 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:22:55.434277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:55.434946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:55.437383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:55.442371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:55.442854 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:55.443583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:55.444483 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:55.444940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:55.445411 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:55.575130 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:55.583555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:55.585278 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:55.586454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4e04d463-e024-4be8-8471-e1550adcfbd1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1716 microversion: 2.20 time: 0.156276 Aug 18 17:22:55.587054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 454/885] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:22:55 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:22:56.027754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:56.027754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:56.028353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-bea16d53-f717-4731-8a91-bd10038bebcd req-e861722a-8093-4a0a-8e10-46594fa4293f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:56.028450 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:56.028551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:56.028941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:56.029646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:56.030090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:56.030699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:56.032856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-bea16d53-f717-4731-8a91-bd10038bebcd req-e861722a-8093-4a0a-8e10-46594fa4293f service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:56.033672 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-bea16d53-f717-4731-8a91-bd10038bebcd req-e861722a-8093-4a0a-8e10-46594fa4293f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:56.034324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-bea16d53-f717-4731-8a91-bd10038bebcd req-e861722a-8093-4a0a-8e10-46594fa4293f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:56.058387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:22:56.066545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-bea16d53-f717-4731-8a91-bd10038bebcd req-e861722a-8093-4a0a-8e10-46594fa4293f service nova] Creating event network-changed:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:22:56.069695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-bea16d53-f717-4731-8a91-bd10038bebcd req-e861722a-8093-4a0a-8e10-46594fa4293f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051112 Aug 18 17:22:56.070918 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 455/886] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:22:56.398456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b991fbd4-3c9c-4c47-b56e-b8386d615acc tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 204 len: 0 microversion: 2.1 time: 0.381752 Aug 18 17:22:56.399068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 432/887] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:22:56 2022] DELETE /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:22:56.408164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:56.408872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:56.416326 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:56.416835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:56.417273 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:56.417979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:56.418463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:56.418880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:56.560777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:56.569558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-059f30f0-0512-486d-a906-0187f749b428 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.165833 Aug 18 17:22:56.570175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 456/888] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:22:56 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:22:57.591152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:57.592049 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:57.598408 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:57.598890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:57.599557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:57.600443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:57.600903 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:57.601324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:57.929350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:57.937558 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e8396c97-1e3a-4f67-a442-6fd67be3beb4 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1568 microversion: 2.1 time: 0.350266 Aug 18 17:22:57.937663 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 433/889] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:22:57 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:22:58.924502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-6ea395c0-0477-441c-b4b7-f8f3a63ae376 req-976bbb02-e0bd-4f3b-97a2-bd315ae782ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e02d3e-7dbb-4aba-9fcd-357539efba50", "name": "network-vif-deleted", "tag": "44053fe2-e5d4-4165-94d3-50fe329ed55f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:22:58.934663 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-6ea395c0-0477-441c-b4b7-f8f3a63ae376 req-976bbb02-e0bd-4f3b-97a2-bd315ae782ed service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:58.940599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-6ea395c0-0477-441c-b4b7-f8f3a63ae376 req-976bbb02-e0bd-4f3b-97a2-bd315ae782ed service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:58.940599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-6ea395c0-0477-441c-b4b7-f8f3a63ae376 req-976bbb02-e0bd-4f3b-97a2-bd315ae782ed service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:58.946818 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-6ea395c0-0477-441c-b4b7-f8f3a63ae376 req-976bbb02-e0bd-4f3b-97a2-bd315ae782ed service nova] Creating event network-vif-deleted:44053fe2-e5d4-4165-94d3-50fe329ed55f for instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 on hv-cinder-85367 Aug 18 17:22:58.951777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-6ea395c0-0477-441c-b4b7-f8f3a63ae376 req-976bbb02-e0bd-4f3b-97a2-bd315ae782ed service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031402 Aug 18 17:22:58.952349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 457/890] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:22:58.959907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:22:58.960651 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:22:58.967340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:58.967825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:58.968264 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:58.968971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:22:58.969424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:22:58.969849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:22:59.041481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:22:59.055116 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-feb8dc64-d2ed-496a-ad63-c88f7d5e5397 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1383 microversion: 2.1 time: 0.099546 Aug 18 17:22:59.055635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 434/891] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:22:58 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1383 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:00.077936 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:00.083621 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:00.085762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:00.086251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:00.086688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:00.087425 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:00.088029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:00.088609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:00.127837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:00.128280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:00.129644 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:00.130239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lazy-loading 'fault' on Instance uuid c9e02d3e-7dbb-4aba-9fcd-357539efba50 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:23:00.175688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc5df40911b4186abec99c01e0702a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8802bed1f6b4be991ff011f40bf8622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:00.184703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d08e2bc9-c69c-4dec-b62b-90cc19e2f0f6 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 200 len: 1225 microversion: 2.1 time: 0.111357 Aug 18 17:23:00.185574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 458/892] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:00 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:00.220757 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-284ecd5f-434f-403c-8779-c1e6f0785057 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:23:00.228082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-284ecd5f-434f-403c-8779-c1e6f0785057 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:00.229913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-284ecd5f-434f-403c-8779-c1e6f0785057 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:00.229913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-284ecd5f-434f-403c-8779-c1e6f0785057 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:00.289994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-284ecd5f-434f-403c-8779-c1e6f0785057 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Going to try to stop instance {{(pid=121217) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 17:23:00.460150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-284ecd5f-434f-403c-8779-c1e6f0785057 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action" status: 202 len: 0 microversion: 2.1 time: 0.242990 Aug 18 17:23:00.460841 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 435/893] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:23:00 2022] POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:23:00.469180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:00.469777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:00.476700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:00.477181 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:00.477616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:00.478309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:00.478759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:00.479225 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:00.611790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:00.619938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a2efc290-c2b3-49ad-af4b-5ac42c3d542f tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.154634 Aug 18 17:23:00.620508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 459/894] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:00 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:01.211212 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:01.211973 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] [instance: c9e02d3e-7dbb-4aba-9fcd-357539efba50] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:01.218028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:01.218506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:01.218962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:01.219658 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:01.220110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:01.220533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:01.233417 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] HTTP exception thrown: Instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 could not be found. Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Request method failure captured: Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 HTTP/1.1 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nOgY_QR0QS9Fo8nX8CfDdRSDYhjL4tf-Xmd8htmcxWWusbRP_SywR5Chqm4ePfxAfohFq3JKeeluMLIKAiBgfdk5ZreqIGzVAhopunMEjMgyrqnNu2wyiuohfffsogLmR1G7VRoPzQspdUNNFGXZt00aU-wZ6UBUmrEUT4rbhTb0b0 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: f8802bed1f6b4be991ff011f40bf8622 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-TestShelveInstance-1564365042 Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:23:01.235036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f8802bed1f6b4be991ff011f40bf8622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_f8802bed1f6b4be991ff011f40bf8622"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/f8802bed1f6b4be991ff011f40bf8622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/f8802bed1f6b4be991ff011f40bf8622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-TestShelveInstance-1564365042 Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: f8802bed1f6b4be991ff011f40bf8622 Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-TestShelveInstance-1564365042 Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-TestShelveInstance-1564365042-project Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: ebc5df40911b4186abec99c01e0702a6 Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-TestShelveInstance-1564365042-project Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 could not be found. Aug 18 17:23:01.236657 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'c9e02d3e-7dbb-4aba-9fcd-357539efba50'} Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 could not be found. Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:23:01.237515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 could not be found. Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 could not be found. Aug 18 17:23:01.238793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:23:01.240843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Returning 404 to user: Instance c9e02d3e-7dbb-4aba-9fcd-357539efba50 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:23:01.240843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3216432c-c7be-40ab-96ed-e98bd18b0377 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50" status: 404 len: 111 microversion: 2.1 time: 0.029596 Aug 18 17:23:01.240843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 436/895] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:01 2022] GET /compute/v2.1/servers/c9e02d3e-7dbb-4aba-9fcd-357539efba50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:23:01.454967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f2b7e59d-44e9-4133-bce9-4a06af24e779 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] Calling method '.version_select at 0x7fd1fb5473a0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:01.525385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f2b7e59d-44e9-4133-bce9-4a06af24e779 tempest-TestShelveInstance-1564365042 tempest-TestShelveInstance-1564365042-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2080356117" status: 202 len: 0 microversion: 2.1 time: 0.074171 Aug 18 17:23:01.526100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 460/896] 10.222.0.82 () {58 vars in 1254 bytes} [Thu Aug 18 17:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2080356117 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:23:01.640500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:01.641271 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:01.647330 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:01.647825 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:01.648296 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:01.649002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:01.649461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:01.649892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:01.866582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:01.874894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0488f84b-302e-4d04-bf86-308ca8ff1dc0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.238252 Aug 18 17:23:01.875479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 437/897] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:01 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:02.896883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:02.897838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:02.905186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:02.905604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:02.906030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:02.906716 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:02.907198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:02.907613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:03.118811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:03.126979 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ddc70faa-9e59-4c6d-acc0-e5e6d2fdf314 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.234645 Aug 18 17:23:03.127550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 461/898] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:02 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:04.149151 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:04.150447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:04.157477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:04.166989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:04.166989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:04.166989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:04.166989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:04.167374 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:04.620668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:04.629536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8524cccb-3b76-441c-92e7-e8fc35da819d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.484462 Aug 18 17:23:04.630464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 438/899] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:04 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:05.651116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:05.651658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:05.657877 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:05.658352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:05.658778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:05.659491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:05.659940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:05.660356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:05.881614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:05.890016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-48a6fdc8-e974-4e44-9b1b-1eeb52872cc3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.242872 Aug 18 17:23:05.890590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 462/900] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:05 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:06.911338 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:06.912131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:06.919081 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:06.919648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:06.920154 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:06.920934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:06.921453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:06.921946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:07.167087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:07.175421 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9e271d27-9412-485b-a48e-50a718bfe8aa tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.267852 Aug 18 17:23:07.187624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 439/901] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:06 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:08.203737 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:08.204343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:08.212007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:08.212630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:08.213069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:08.213895 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:08.214388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:08.214799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:08.392822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:08.405806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6efcfd08-e420-48aa-a80f-72dfdd81e1e1 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.205805 Aug 18 17:23:08.409266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 463/902] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:08 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:09.428404 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:09.429011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:09.435542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:09.436125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:09.436559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:09.437258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:09.437716 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:09.438142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:09.578423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:09.587369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-de12476d-2f9f-4ca9-bc09-7aa3fc9c4233 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.163373 Aug 18 17:23:09.587927 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 440/903] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:09 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:10.609593 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:10.610056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:10.616990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:10.617625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:10.618143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:10.618929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:10.619541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:10.619975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:10.752316 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:10.760556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-177a2b20-f9aa-4ca5-8325-678dff8261b9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1723 microversion: 2.1 time: 0.155354 Aug 18 17:23:10.761118 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 464/904] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:10 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:11.781515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:11.782126 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:11.789507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:11.789989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:11.790427 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:11.791164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:11.791620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:11.792046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:11.922357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:11.931175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5ca93f57-5b3a-4b8a-ae41-52f8a2299753 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1700 microversion: 2.1 time: 0.153518 Aug 18 17:23:11.931739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 441/905] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:11 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:11.952056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-99dfe2c5-9181-4191-9e0a-70f15282d9f3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:23:11.958507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c5-9181-4191-9e0a-70f15282d9f3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:11.959020 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c5-9181-4191-9e0a-70f15282d9f3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:11.962261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c5-9181-4191-9e0a-70f15282d9f3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:12.019120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-99dfe2c5-9181-4191-9e0a-70f15282d9f3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Going to try to start instance {{(pid=121216) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 17:23:12.224028 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-99dfe2c5-9181-4191-9e0a-70f15282d9f3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action" status: 202 len: 0 microversion: 2.1 time: 0.275636 Aug 18 17:23:12.224771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 465/906] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:23:11 2022] POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:23:12.237227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:12.238355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:12.247056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:12.247585 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:12.248024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:12.248719 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:12.249174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:12.249598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:12.386579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:12.395589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c0476ddc-0dc1-4c31-9a3e-1e66bea4f2f6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1709 microversion: 2.1 time: 0.165609 Aug 18 17:23:12.396163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 442/907] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:12 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:13.417802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:13.418493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:13.425206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:13.425689 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:13.426120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:13.426810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:13.427288 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:13.427713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:13.562678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:13.571306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-43e39cd4-a548-4fdb-966b-8424f8953b18 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1709 microversion: 2.1 time: 0.158376 Aug 18 17:23:13.571877 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 466/908] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:13 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:14.592234 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:14.592844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:14.599192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:14.599664 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:14.600093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:14.600773 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:14.601219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:14.601695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:14.732455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:14.740457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c20ede78-e097-42cf-b573-c146d09ee74d tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1713 microversion: 2.1 time: 0.152142 Aug 18 17:23:14.741014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 443/909] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:14 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:34.101643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1899137578", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-959238922", "security_groups": [{"name": "tempest-secgroup-smoke-1712538356"}], "block_device_mapping_v2": [{"uuid": "ebe2f00a-7557-46a5-a9f1-0d55d6589ffa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0c6229eb-eed2-4407-a072-5471b2488cad"}]}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:23:34.111595 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:34.112262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:34.215119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] validate_networks() for [('0c6229eb-eed2-4407-a072-5471b2488cad', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:23:34.601146 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:23:34.602126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:23:34.602625 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:23:34.603069 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:23:34.603480 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:23:34.612164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:34.612637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:34.613068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:34.613790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:34.614239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:34.614659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:34.631719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for project e976b3d87de347818a3c62fa4806db98. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:23:34.635843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Getting quotas for user 04ab53c336934355a0000bda59fa7e7c and project e976b3d87de347818a3c62fa4806db98. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:23:34.692134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:23:34.694240 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebe2f00a-7557-46a5-a9f1-0d55d6589ffa',volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:23:35.058411 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1de3182d-599d-4660-865a-429bfbb5a1a6 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960783 Aug 18 17:23:35.059101 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 467/910] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:23:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:23:35.070824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fcc66bd5-80b7-4ede-adc6-1a56162ff6e4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:35.071607 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fcc66bd5-80b7-4ede-adc6-1a56162ff6e4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:35.075549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:35.076272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:35.126645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fcc66bd5-80b7-4ede-adc6-1a56162ff6e4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:35.134244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fcc66bd5-80b7-4ede-adc6-1a56162ff6e4 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1094 microversion: 2.1 time: 0.067981 Aug 18 17:23:35.134805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 444/911] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:35 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:36.155786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:36.156395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:36.163143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:36.164843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:36.164843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:36.165337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:36.165790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:36.166214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:36.231441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:36.239103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-18bac246-d35b-4bd7-ad2d-c4d641c62572 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1144 microversion: 2.1 time: 0.087638 Aug 18 17:23:36.239657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 468/912] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:36 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:37.261258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:37.264746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:37.270809 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:37.271314 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:37.271776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:37.272470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:37.272937 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:37.273370 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:37.347173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:37.355802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4ad7a30b-a2d7-4832-89a2-677413de577b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1200 microversion: 2.1 time: 0.098995 Aug 18 17:23:37.370187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 445/913] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:37 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1200 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:38.378798 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:38.379454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:38.387057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:38.387875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:38.388538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:38.389453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:38.389902 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:38.390502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:38.777380 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:38.789183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4806d2a0-fa0f-4688-be26-babf5520918b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1278 microversion: 2.1 time: 0.414428 Aug 18 17:23:38.789771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 469/914] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:38 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1278 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:39.412877 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-114ff504-8850-4a2b-b375-d6ee5c4b0987 req-ac798a18-69b2-4ed7-9ca1-1aa9ee744e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a70040-3d92-4837-8631-50a5dc77cb53", "tag": "3396a21f-3273-4ff1-8309-fb5e294ebdc8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:23:39.423731 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-114ff504-8850-4a2b-b375-d6ee5c4b0987 req-ac798a18-69b2-4ed7-9ca1-1aa9ee744e78 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:39.424213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-114ff504-8850-4a2b-b375-d6ee5c4b0987 req-ac798a18-69b2-4ed7-9ca1-1aa9ee744e78 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:39.424642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-114ff504-8850-4a2b-b375-d6ee5c4b0987 req-ac798a18-69b2-4ed7-9ca1-1aa9ee744e78 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:39.438491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-114ff504-8850-4a2b-b375-d6ee5c4b0987 req-ac798a18-69b2-4ed7-9ca1-1aa9ee744e78 service nova] Creating event network-changed:3396a21f-3273-4ff1-8309-fb5e294ebdc8 for instance a9a70040-3d92-4837-8631-50a5dc77cb53 on hv-cinder-85367 Aug 18 17:23:39.444459 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-114ff504-8850-4a2b-b375-d6ee5c4b0987 req-ac798a18-69b2-4ed7-9ca1-1aa9ee744e78 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035536 Aug 18 17:23:39.445112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 446/915] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:23:39.810049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:39.810700 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:39.817497 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:39.817980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:39.818419 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:39.819164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:39.819623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:39.820683 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:39.981933 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:39.989644 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9686e919-9805-4298-aae5-62637f84ef42 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.183604 Aug 18 17:23:39.990224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 470/916] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:39 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:41.012611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:41.013306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:41.019511 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:41.019942 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:41.020376 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:41.021061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:41.021512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:41.021933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:41.153875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:41.161580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1f79348d-b665-4b31-8ba5-140b24d6676b tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.154049 Aug 18 17:23:41.162152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 447/917] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:41 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:42.183204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:42.183812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:42.190400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:42.190873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:42.191328 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:42.192014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:42.192465 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:42.192886 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:42.331280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:42.339363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-479b95fd-190e-4515-8deb-fd5185545336 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.160764 Aug 18 17:23:42.339927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 471/918] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:42 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:43.360180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:43.360791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:43.367453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:43.367938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:43.368382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:43.369084 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:43.369540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:43.369965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:43.497893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:43.505528 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-03af01f7-5630-4557-89f8-e0df4dc7ad43 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.149241 Aug 18 17:23:43.506087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 448/919] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:43 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:44.525751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:44.526527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:44.532869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:44.533348 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:44.533782 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:44.534468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:44.534938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:44.535365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:44.622457 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:44.643001 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:44.667431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:44.674957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-17f9160c-65f7-4569-a787-7824bebbcbfe tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.153275 Aug 18 17:23:44.675523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 472/920] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:44 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:45.697016 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:45.697639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:45.700167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:23:45.704960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:45.705448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:45.705884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:45.706579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:45.707069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:45.707540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:45.842549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:45.850217 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-77cabdd5-ac01-4a0e-ae6a-5e33f9455ea9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.157741 Aug 18 17:23:45.858802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 449/921] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:45 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:46.870598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:46.871222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:46.878535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:46.879041 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:46.879470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:46.880147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:46.880591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:46.881006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:47.013219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:47.020847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cc734056-86f8-48b8-a9ea-e3592e5d092c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.154080 Aug 18 17:23:47.021344 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 473/922] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:46 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:48.042294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:48.042923 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:48.049247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:48.049726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:48.050156 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:48.050846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:48.051324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:48.051748 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:48.178427 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:48.186941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fb9f255e-726e-4e81-99e7-b3a41fde843c tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.148476 Aug 18 17:23:48.187509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 450/923] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:48 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:49.208650 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:49.209257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:49.216223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:49.216704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:49.217128 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:49.217809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:49.218281 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:49.218699 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:49.348618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:49.356410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-64179075-4117-4fd6-a028-88e15e91cda9 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.151578 Aug 18 17:23:49.356973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 474/924] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:49 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:50.377257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:50.377792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:50.384278 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:50.384761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:50.385195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:50.385885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:50.386336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:50.386759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:50.522259 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:50.530980 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4a1cd90d-e136-4d71-b0ee-55ac5b355f50 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.157627 Aug 18 17:23:50.531552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 451/925] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:50 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:51.552510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:51.553120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:51.560235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:51.560719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:51.561174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:51.561862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:51.562313 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:51.562735 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:51.690381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:51.698154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-20494c26-2f0f-479e-a6dc-ee2e5caef3b2 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.149508 Aug 18 17:23:51.698728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 475/926] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:51 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:52.190636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-a2146ff0-a841-4aae-ac5e-45eceafe9182 req-4824be5e-6e57-45dc-a1bd-ed68987a1ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a70040-3d92-4837-8631-50a5dc77cb53", "name": "network-vif-plugged", "status": "completed", "tag": "3396a21f-3273-4ff1-8309-fb5e294ebdc8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:23:52.200272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-a2146ff0-a841-4aae-ac5e-45eceafe9182 req-4824be5e-6e57-45dc-a1bd-ed68987a1ea3 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:52.200741 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-a2146ff0-a841-4aae-ac5e-45eceafe9182 req-4824be5e-6e57-45dc-a1bd-ed68987a1ea3 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:52.201166 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-a2146ff0-a841-4aae-ac5e-45eceafe9182 req-4824be5e-6e57-45dc-a1bd-ed68987a1ea3 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:52.212551 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-a2146ff0-a841-4aae-ac5e-45eceafe9182 req-4824be5e-6e57-45dc-a1bd-ed68987a1ea3 service nova] Creating event network-vif-plugged:3396a21f-3273-4ff1-8309-fb5e294ebdc8 for instance a9a70040-3d92-4837-8631-50a5dc77cb53 on hv-cinder-85367 Aug 18 17:23:52.217550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-a2146ff0-a841-4aae-ac5e-45eceafe9182 req-4824be5e-6e57-45dc-a1bd-ed68987a1ea3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150931 Aug 18 17:23:52.218120 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 452/927] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:23:52.718629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:52.719264 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:52.725591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:52.726960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:52.727395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:52.728075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:52.728523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:52.728940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:52.858263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:52.865812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f78dc92e-905a-4369-91ca-d7356f2fa246 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.151012 Aug 18 17:23:52.866368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 476/928] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:52 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:53.888474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:53.889160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:53.895381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:53.895850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:53.896275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:53.896954 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:53.897396 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:53.897879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:54.035970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:54.044738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9c4fec04-cc0e-4a18-8b79-8aa0ce6642ad tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1266 microversion: 2.1 time: 0.161199 Aug 18 17:23:54.045304 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 453/929] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:53 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:55.065971 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:55.066600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:55.073389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:55.073867 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:55.074298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:55.075018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:55.075474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:55.075897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:55.207653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:55.216056 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3a7785ed-b9dc-4ca6-92a8-c4d6095f5cc7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1452 microversion: 2.1 time: 0.154354 Aug 18 17:23:55.216618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 477/930] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:55 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:55.236616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:23:55.237243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:23:55.243616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:55.244102 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:55.244532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:55.245226 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:55.245678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:55.246103 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:55.375179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:23:55.383448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-12f2e9ad-13e1-4d96-aa67-20d106402243 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1452 microversion: 2.1 time: 0.150730 Aug 18 17:23:55.384012 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 454/931] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:23:55 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:23:57.538835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-37c3ae4a-8fc8-4523-bd01-1a55e19d6010 req-8ff99d45-23b9-445d-8071-b976bf6e567b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a70040-3d92-4837-8631-50a5dc77cb53", "tag": "3396a21f-3273-4ff1-8309-fb5e294ebdc8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:23:57.548703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-37c3ae4a-8fc8-4523-bd01-1a55e19d6010 req-8ff99d45-23b9-445d-8071-b976bf6e567b service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:23:57.549181 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-37c3ae4a-8fc8-4523-bd01-1a55e19d6010 req-8ff99d45-23b9-445d-8071-b976bf6e567b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:23:57.549596 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-37c3ae4a-8fc8-4523-bd01-1a55e19d6010 req-8ff99d45-23b9-445d-8071-b976bf6e567b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:23:57.561040 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-37c3ae4a-8fc8-4523-bd01-1a55e19d6010 req-8ff99d45-23b9-445d-8071-b976bf6e567b service nova] Creating event network-changed:3396a21f-3273-4ff1-8309-fb5e294ebdc8 for instance a9a70040-3d92-4837-8631-50a5dc77cb53 on hv-cinder-85367 Aug 18 17:23:57.566276 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-37c3ae4a-8fc8-4523-bd01-1a55e19d6010 req-8ff99d45-23b9-445d-8071-b976bf6e567b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Aug 18 17:23:57.566864 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 478/932] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:24:11.999067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:12.001204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:12.003394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=24 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:12.004068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=52 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:12.008840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:12.009324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:12.009932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:12.010638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:12.011122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:12.011566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:12.040708 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7950359b-3fb9-4622-899d-b0b1a191d814 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045823 Aug 18 17:24:12.041289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 455/933] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 17:24:11 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:12.103987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:12.104725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=64 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:12.108674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:12.109259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:12.115197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:12.115676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:12.116113 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:12.116801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:12.117251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:12.117726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:12.142398 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Going to try to terminate instance {{(pid=121216) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:24:12.381231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5408ed6d-1ac8-45c5-93e6-dbd9fb165533 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 204 len: 0 microversion: 2.20 time: 0.279066 Aug 18 17:24:12.381742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 479/934] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 17:24:12 2022] DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:24:12.390275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:12.390882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:12.397292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:12.397762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:12.398193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:12.399610 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:12.400212 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:12.400636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:12.533090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:12.541589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:12.543136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:12.544281 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-92465314-2d25-45a9-8993-000a7369c1eb tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.157943 Aug 18 17:24:12.544891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 456/935] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:12 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:24:13.568415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:13.569116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:13.575503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:13.575988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:13.576451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:13.577147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:13.577601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:13.578057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:13.708140 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:13.716969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:13.718479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:13.719684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c14b16cf-c0a0-4389-bbc6-f2af12c9d12a tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.155986 Aug 18 17:24:13.720252 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 480/936] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:13 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:24:14.744007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:14.744615 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:14.751115 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:14.751606 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:14.752043 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:14.752744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:14.753185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:14.753614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:14.948112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:14.956912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:14.958393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:14.959586 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1138c035-cc4b-4c91-b59f-50fbcf65139f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1722 microversion: 2.20 time: 0.220307 Aug 18 17:24:14.960144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 457/937] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:14 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:24:15.338554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-957e2a62-0df1-4a97-8b46-abc896af9f7c req-8ae2c1de-1c89-4fbb-b8fd-424c813bdc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3a9074-980b-4900-941f-59ac5d780fef", "name": "network-vif-deleted", "tag": "5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:15.348307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-957e2a62-0df1-4a97-8b46-abc896af9f7c req-8ae2c1de-1c89-4fbb-b8fd-424c813bdc4c service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:15.348774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-957e2a62-0df1-4a97-8b46-abc896af9f7c req-8ae2c1de-1c89-4fbb-b8fd-424c813bdc4c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:15.349202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-957e2a62-0df1-4a97-8b46-abc896af9f7c req-8ae2c1de-1c89-4fbb-b8fd-424c813bdc4c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:15.361371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-957e2a62-0df1-4a97-8b46-abc896af9f7c req-8ae2c1de-1c89-4fbb-b8fd-424c813bdc4c service nova] Creating event network-vif-deleted:5fcb2bd2-fe3c-476b-84b0-ee3d92026d6e for instance 9b3a9074-980b-4900-941f-59ac5d780fef on hv-cinder-85367 Aug 18 17:24:15.366788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-957e2a62-0df1-4a97-8b46-abc896af9f7c req-8ae2c1de-1c89-4fbb-b8fd-424c813bdc4c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Aug 18 17:24:15.368478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 481/938] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:24:15.982550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:15.983202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:15.989702 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:15.990185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:15.990620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:15.991347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:15.991800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:15.992224 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:16.024367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:16.024722 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:16.025158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:16.025602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lazy-loading 'fault' on Instance uuid 9b3a9074-980b-4900-941f-59ac5d780fef {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:24:16.069062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:16.078043 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:16.079612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22e737cba90b4d8890ecd692e6456470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d1a4ac5307416f8569267bf2f2d827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:16.080764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-40742f13-b0ba-489f-92c6-1335818fe2c8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 200 len: 1370 microversion: 2.20 time: 0.102121 Aug 18 17:24:16.081426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 458/939] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:15 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:24:16.642527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:24:16.642720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:24:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:24:17.105602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:17.106325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:17.112446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:17.112925 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:17.113359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:17.114049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:17.114501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:17.114947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:17.128190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] HTTP exception thrown: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Request method failure captured: Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef HTTP/1.1 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nL9yPhX9NHjLb9VJyIZKX5-t3t1XyG4gSiwUQ2NfnR-efTGilWzcttIydKpvg4ukufs9YenZfvD00cXwoWEtdlMSzco8YtP2YMNdThwkvsk0cEKOoGOTv1ML-Jc4gnYbKguC2uZbk3EBgKIBDS9kQfk1sK3RXhjihn2BoApXdoIq5o Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:24:17.129790 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 22e737cba90b4d8890ecd692e6456470 Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:17.131543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '9b3a9074-980b-4900-941f-59ac5d780fef'} Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:24:17.132432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:17.134201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:17.135656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Returning 404 to user: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:24:17.135656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-972d6ed8-6069-41fa-8901-39c89d6442d8 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 404 len: 111 microversion: 2.20 time: 0.030908 Aug 18 17:24:17.135656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 482/940] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:17 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:24:17.140274 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f616d588-a947-461f-be80-33065218a6de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '.version_select at 0x7fd1f2c010d0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:17.244878 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f616d588-a947-461f-be80-33065218a6de tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422913678" status: 204 len: 0 microversion: 2.20 time: 0.108489 Aug 18 17:24:17.245503 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 459/941] 10.222.0.82 () {60 vars in 1259 bytes} [Thu Aug 18 17:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422913678 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:24:19.267831 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:19.268325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:19.275167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:19.275643 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:19.276076 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:19.276763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:19.277215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:19.277642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:19.291456 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] HTTP exception thrown: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Request method failure captured: Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef HTTP/1.1 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nL9yPhX9NHjLb9VJyIZKX5-t3t1XyG4gSiwUQ2NfnR-efTGilWzcttIydKpvg4ukufs9YenZfvD00cXwoWEtdlMSzco8YtP2YMNdThwkvsk0cEKOoGOTv1ML-Jc4gnYbKguC2uZbk3EBgKIBDS9kQfk1sK3RXhjihn2BoApXdoIq5o Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:24:19.293022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 22e737cba90b4d8890ecd692e6456470 Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.294630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '9b3a9074-980b-4900-941f-59ac5d780fef'} Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:24:19.295702 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.297110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.298653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Returning 404 to user: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:24:19.298653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4d22506a-305a-4863-bd82-c92744dc6fe3 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 404 len: 111 microversion: 2.20 time: 0.030371 Aug 18 17:24:19.298653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 483/942] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 17:24:19 2022] DELETE /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:24:19.303364 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:19.307475 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: 9b3a9074-980b-4900-941f-59ac5d780fef] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:19.311369 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:19.311862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:19.312301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:19.312995 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:19.313449 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:19.313875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:19.327130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] HTTP exception thrown: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Request method failure captured: Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef HTTP/1.1 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nL9yPhX9NHjLb9VJyIZKX5-t3t1XyG4gSiwUQ2NfnR-efTGilWzcttIydKpvg4ukufs9YenZfvD00cXwoWEtdlMSzco8YtP2YMNdThwkvsk0cEKOoGOTv1ML-Jc4gnYbKguC2uZbk3EBgKIBDS9kQfk1sK3RXhjihn2BoApXdoIq5o Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:24:19.328768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 22e737cba90b4d8890ecd692e6456470 Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.330363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '9b3a9074-980b-4900-941f-59ac5d780fef'} Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:24:19.331260 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. Aug 18 17:24:19.332710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:19.334028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Returning 404 to user: Instance 9b3a9074-980b-4900-941f-59ac5d780fef could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:24:19.334028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6a6e43a3-a54f-4ba8-b7f8-1dd385fdccf1 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef" status: 404 len: 111 microversion: 2.20 time: 0.031207 Aug 18 17:24:19.334028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 460/943] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:19 2022] GET /compute/v2.1/servers/9b3a9074-980b-4900-941f-59ac5d780fef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 17:24:20.628936 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:20.629427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:20.635820 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:20.636285 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:20.636717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:20.637397 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:20.637841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:20.638280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:20.651436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] HTTP exception thrown: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Request method failure captured: Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 HTTP/1.1 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nL9yPhX9NHjLb9VJyIZKX5-t3t1XyG4gSiwUQ2NfnR-efTGilWzcttIydKpvg4ukufs9YenZfvD00cXwoWEtdlMSzco8YtP2YMNdThwkvsk0cEKOoGOTv1ML-Jc4gnYbKguC2uZbk3EBgKIBDS9kQfk1sK3RXhjihn2BoApXdoIq5o Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:24:20.652981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 22e737cba90b4d8890ecd692e6456470 Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.654574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'a30b49e2-6995-4078-b762-0ac46cc2b043'} Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:24:20.655578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.657018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.658548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Returning 404 to user: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:24:20.658548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-54aaf33c-5953-4105-8a1b-c8bcdafbab08 tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 404 len: 111 microversion: 2.20 time: 0.029278 Aug 18 17:24:20.658548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 484/944] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 17:24:20 2022] DELETE /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:24:20.662571 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:20.663204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] [instance: a30b49e2-6995-4078-b762-0ac46cc2b043] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:20.670153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:20.670625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:20.671109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:20.671800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:20.673119 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:20.673546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:20.686983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] HTTP exception thrown: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Request method failure captured: Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 HTTP/1.1 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nL9yPhX9NHjLb9VJyIZKX5-t3t1XyG4gSiwUQ2NfnR-efTGilWzcttIydKpvg4ukufs9YenZfvD00cXwoWEtdlMSzco8YtP2YMNdThwkvsk0cEKOoGOTv1ML-Jc4gnYbKguC2uZbk3EBgKIBDS9kQfk1sK3RXhjihn2BoApXdoIq5o Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:24:20.688482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/d1d1a4ac5307416f8569267bf2f2d827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: d1d1a4ac5307416f8569267bf2f2d827 Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323305279 Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 22e737cba90b4d8890ecd692e6456470 Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323305279-project Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.690324 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'a30b49e2-6995-4078-b762-0ac46cc2b043'} Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:24:20.691233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. Aug 18 17:24:20.692654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:24:20.693941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] Returning 404 to user: Instance a30b49e2-6995-4078-b762-0ac46cc2b043 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:24:20.693941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ba0af903-9321-4254-98bb-b74d4da1466f tempest-AttachVolumeShelveTestJSON-1323305279 tempest-AttachVolumeShelveTestJSON-1323305279-project] 10.222.0.82 "GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043" status: 404 len: 111 microversion: 2.20 time: 0.031036 Aug 18 17:24:20.693941 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 461/945] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 17:24:20 2022] GET /compute/v2.1/servers/a30b49e2-6995-4078-b762-0ac46cc2b043 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:24:26.331786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:26.332354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:26.338641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:26.339350 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:26.340387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:26.340509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:26.340934 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:26.341362 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:26.427586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lazy-loading 'services' on Instance uuid f25511a4-8386-4e28-af43-fd634d160293 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:24:26.631771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-353c42ba-77b2-4653-bcc8-7215d8fbd2e9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-volume_attachments/3ac94622-9683-4967-9332-a4649470146c" status: 202 len: 0 microversion: 2.1 time: 0.304231 Aug 18 17:24:26.632361 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 485/946] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:24:26 2022] DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-volume_attachments/3ac94622-9683-4967-9332-a4649470146c => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:24:27.773723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e076b9c8-1bc3-4045-a05f-8e4dfcfa922c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:27.780864 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e076b9c8-1bc3-4045-a05f-8e4dfcfa922c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:27.781355 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e076b9c8-1bc3-4045-a05f-8e4dfcfa922c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:27.781786 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e076b9c8-1bc3-4045-a05f-8e4dfcfa922c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:27.804885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e076b9c8-1bc3-4045-a05f-8e4dfcfa922c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Going to try to stop instance {{(pid=121217) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 17:24:28.020583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e076b9c8-1bc3-4045-a05f-8e4dfcfa922c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action" status: 202 len: 0 microversion: 2.1 time: 0.250475 Aug 18 17:24:28.021430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 462/947] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:24:27 2022] POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:24:28.052745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:28.060028 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:28.069202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:28.069719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:28.070186 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:28.078022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:28.078517 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:28.078998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:28.279792 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:28.288399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cb85c958-b547-4f0e-bb46-601ad3ca7463 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.251587 Aug 18 17:24:28.289354 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 486/948] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:28 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:29.312605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:29.313164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:29.320326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:29.321026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:29.321632 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:29.323123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:29.324140 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:29.324730 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:29.470239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:29.480123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5296c3e6-f76b-4c44-91b5-0dd9189cd769 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.171817 Aug 18 17:24:29.480710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 463/949] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:29 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:30.500623 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:30.501824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:30.510678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:30.511206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:30.511645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:30.513088 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:30.513718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:30.514605 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:30.657559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:30.666589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5d873547-8fff-494b-a4de-db2b77c4771c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.169808 Aug 18 17:24:30.667192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 487/950] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:30 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:31.366536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bb100a9e-a936-472b-a50a-10a0910c3e14 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: .version_select at 0x7fd1f3731550>, body: {"keypair": {"name": "tempest-keypair-59093405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTARl4jepRruBqiMjhKiVjn1p+YLq+xmYpKnRbLhzIkcMEMxH2Oyp9zBgWdeiAheOFDvwU25qyrcM2uaCEyi+V/F+/8WBqvSp5upxV2LGHBniSR0L157NOS5GDSb57Z8g=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:31.382608 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-bb100a9e-a936-472b-a50a-10a0910c3e14 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:24:31.387014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-bb100a9e-a936-472b-a50a-10a0910c3e14 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:24:31.491274 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bb100a9e-a936-472b-a50a-10a0910c3e14 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.245935 Aug 18 17:24:31.491876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 464/951] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:24:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:24:31.688014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:31.688770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:31.695470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:31.695955 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:31.696396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:31.697574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:31.698362 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:31.698717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:31.840313 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:31.848817 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6ff50a13-cd9b-41d0-bae9-fac205714428 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.164583 Aug 18 17:24:31.849682 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 488/952] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:31 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:24:32.871332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:32.871885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:32.879723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:32.880308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:32.881220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:32.882022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:32.882763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:32.883296 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:33.023509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:33.032512 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a6a237e4-3b77-47e2-9a15-e3770235888c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.166650 Aug 18 17:24:33.033091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 465/953] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:32 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:33.834802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-387668048", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3c0c0db-a3aa-43d0-b2aa-cb12907841f7"}], "security_groups": [{"name": "tempest-securitygroup--117453569"}], "key_name": "tempest-keypair-59093405", "user_data": "}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:33.946338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] validate_networks() for [('b3c0c0db-a3aa-43d0-b2aa-cb12907841f7', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:24:34.053737 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:34.054598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:34.062258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:34.064088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:34.064088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:34.064701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:34.064839 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:34.065268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:34.318550 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:34.328153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7d7900c8-c67a-43b2-8ef1-a448f9d831d5 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.278254 Aug 18 17:24:34.342275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 466/954] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:34 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:34.446196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:24:34.446636 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:24:34.447763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:24:34.448692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:24:34.449371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:24:34.460492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:34.461209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:34.461793 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:34.462726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:34.463594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:34.464301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:34.484949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:24:34.489298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:24:34.502932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:24:34.507915 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:24:34.649066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-204ca5ea-3e2c-4860-b926-a3273195a8b1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.818542 Aug 18 17:24:34.649721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 489/955] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:24:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:24:34.660513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4c04d739-4bab-47a6-89c9-f4a2d25b0b0a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:34.661236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4c04d739-4bab-47a6-89c9-f4a2d25b0b0a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:34.725910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4c04d739-4bab-47a6-89c9-f4a2d25b0b0a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:34.734373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4c04d739-4bab-47a6-89c9-f4a2d25b0b0a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1239 microversion: 2.1 time: 0.077733 Aug 18 17:24:34.735227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 467/956] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:34 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:35.349530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:35.350140 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:35.356814 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:35.357299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:35.361169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:35.361169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:35.361169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:35.361169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:35.489172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:35.497175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-811d61d9-ac70-45cb-aac4-41af1abebecc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.152219 Aug 18 17:24:35.498667 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 490/957] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:35 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:35.755701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:35.756315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:35.764373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:35.764868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:35.765309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:35.766018 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:35.766475 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:35.766922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:35.832557 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:35.840911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0a9bee31-5186-48c0-be08-70571517d63b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1243 microversion: 2.1 time: 0.089115 Aug 18 17:24:35.841517 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 468/958] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:35 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:36.519540 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:36.520110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:36.527126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:36.527610 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:36.528046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:36.528744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:36.529201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:36.529627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:36.753388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:36.761903 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4b90c183-544a-4cf8-9773-53d4a50a65ba tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.246343 Aug 18 17:24:36.762711 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 491/959] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:36 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:36.861589 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:36.862457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:36.868852 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:36.870573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:36.871170 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:36.871874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:36.873907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:36.873907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:36.946029 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:36.954085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a1c6ce5a-d3eb-4c10-b3c5-365e41ea6916 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1297 microversion: 2.1 time: 0.096332 Aug 18 17:24:36.954648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 469/960] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:36 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:37.782647 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:37.783304 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:37.790217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:37.791798 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:37.792397 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:37.793118 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:37.793578 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:37.794033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:37.975378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:37.975998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:37.983150 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:37.983613 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:37.984163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:37.984693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:37.985464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:37.985951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:37.986365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:37.991630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-481f536e-24c9-4404-8266-52144cc29216 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1677 microversion: 2.1 time: 0.213011 Aug 18 17:24:37.992411 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 492/961] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:37 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:38.203232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:38.211740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-622b598b-b3ef-42da-9203-3423529ffe18 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.240187 Aug 18 17:24:38.213106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 470/962] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:37 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:24:38.432970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-16ba3af5-ec6c-4e3b-81c1-8f78947b3be5 req-108d2047-9282-4c80-9d60-5f2499bc3b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcb74ce-bd3d-4943-9d28-4159511befb7", "tag": "d99b9889-a89e-4be4-a2ab-7dfb4d184542"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:38.444148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-16ba3af5-ec6c-4e3b-81c1-8f78947b3be5 req-108d2047-9282-4c80-9d60-5f2499bc3b96 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:38.444617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-16ba3af5-ec6c-4e3b-81c1-8f78947b3be5 req-108d2047-9282-4c80-9d60-5f2499bc3b96 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:38.445219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-16ba3af5-ec6c-4e3b-81c1-8f78947b3be5 req-108d2047-9282-4c80-9d60-5f2499bc3b96 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:38.458831 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-16ba3af5-ec6c-4e3b-81c1-8f78947b3be5 req-108d2047-9282-4c80-9d60-5f2499bc3b96 service nova] Creating event network-changed:d99b9889-a89e-4be4-a2ab-7dfb4d184542 for instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 on hv-cinder-85367 Aug 18 17:24:38.465409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-16ba3af5-ec6c-4e3b-81c1-8f78947b3be5 req-108d2047-9282-4c80-9d60-5f2499bc3b96 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037127 Aug 18 17:24:38.469529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 493/963] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:24:39.013330 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:39.014038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:39.020398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.020953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.021400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.022094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.022546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.022997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.234750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:39.235511 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:39.242311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.242809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.243279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.244071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.244534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.244964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.381460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:39.390005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-63c46d05-806c-4594-b7e1-db65f125749a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1654 microversion: 2.1 time: 0.380603 Aug 18 17:24:39.390774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 471/964] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:39 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1654 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:39.411662 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-997b18e7-74e2-493e-b2ab-d7da7e357650 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:39.418802 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-997b18e7-74e2-493e-b2ab-d7da7e357650 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.419325 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-997b18e7-74e2-493e-b2ab-d7da7e357650 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.420121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-997b18e7-74e2-493e-b2ab-d7da7e357650 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.452382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-997b18e7-74e2-493e-b2ab-d7da7e357650 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Going to try to start instance {{(pid=121217) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 17:24:39.629529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-997b18e7-74e2-493e-b2ab-d7da7e357650 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action" status: 202 len: 0 microversion: 2.1 time: 0.222068 Aug 18 17:24:39.630142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 472/965] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:24:39 2022] POST /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:24:39.640093 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:39.640720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:39.648072 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.648567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.649012 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.649736 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:39.650243 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:39.650674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:39.670368 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:39.797048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:39.804824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ba1ab705-04ca-4e73-abac-de2e846309e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.574856 Aug 18 17:24:39.814498 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 494/966] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:39 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:24:40.047430 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:40.055548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-65b0dc48-5ec0-4d5c-a614-dca7f2cc515e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1663 microversion: 2.1 time: 0.420669 Aug 18 17:24:40.056125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 473/967] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:39 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1663 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:40.827110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:40.827684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:40.835139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:40.835618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:40.836049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:40.836746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:40.837195 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:40.838241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:40.969793 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:40.977283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d73ffc3a-d7f9-4117-9237-5e9dd9b038be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.154086 Aug 18 17:24:40.977862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 495/968] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:40 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:41.078051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:41.078584 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:41.084913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:41.085394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:41.085829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:41.086518 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:41.086999 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:41.087424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:41.217598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:41.225423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7989de62-273b-4643-889b-0ab762acca53 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1663 microversion: 2.1 time: 0.151294 Aug 18 17:24:41.225991 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 474/969] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:41 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:41.998064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:41.998577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:42.004869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:42.006718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:42.006718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:42.006718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:42.007004 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:42.007257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:42.137860 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:42.145403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-143aa1db-b687-4542-9a89-6ae64017c9c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.151504 Aug 18 17:24:42.145965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 496/970] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:41 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:24:42.245554 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:42.246158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:42.248606 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:42.253252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:42.253774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:42.254218 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:42.254919 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:42.255372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:42.258383 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:42.436079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:42.444788 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-379dae18-7c1a-430c-ac48-88ee924504e7 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1663 microversion: 2.1 time: 0.203011 Aug 18 17:24:42.445386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 475/971] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:42 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1663 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:43.167539 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:43.168188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:43.170560 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:43.175260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:43.175760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:43.176171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:43.176858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:43.177320 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:43.177741 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:43.180279 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:43.312978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:43.321126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a0b5798a-90a1-4c5c-9ba3-26410bd855c5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.158223 Aug 18 17:24:43.321732 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 497/972] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:43 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:43.466251 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:43.466791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:43.473174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:43.473644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:43.474073 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:43.474758 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:43.475233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:43.475659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:43.605103 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:43.612845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7ff058e6-04cc-49ba-8b68-8329cc21ade2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1663 microversion: 2.1 time: 0.151145 Aug 18 17:24:43.613406 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 476/973] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:43 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:44.343290 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:44.343879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:44.350499 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:44.351036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:44.351474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:44.352202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:44.352657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:44.353085 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:44.474053 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:44.499645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:44.506552 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:44.515564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-60056cdc-1d14-4c00-b276-4b3b75acf14f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.176361 Aug 18 17:24:44.516142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 498/974] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:44 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:44.634752 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:44.635490 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:44.642139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:44.642622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:44.643294 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:44.643823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:44.644275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:44.644699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:44.734071 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:44.793354 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:44.802536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b1756151-1917-4b6d-a187-5d05b515bede tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1667 microversion: 2.1 time: 0.171631 Aug 18 17:24:44.803160 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 477/975] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:44 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:24:45.536575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:45.537192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:45.544661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:45.550043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:45.550043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:45.550043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:45.550043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:45.550412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:45.678255 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:45.685935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-45dd8c2c-5fdc-485a-90a9-f7c41bee8ca3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.153222 Aug 18 17:24:45.686499 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 499/976] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:45 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:46.324089 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-854020cb-fd1b-4166-9f78-9b2917b60976 req-dd3a85ef-5583-4489-8a87-574e49fa6b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcb74ce-bd3d-4943-9d28-4159511befb7", "name": "network-vif-plugged", "status": "completed", "tag": "d99b9889-a89e-4be4-a2ab-7dfb4d184542"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:46.333933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-854020cb-fd1b-4166-9f78-9b2917b60976 req-dd3a85ef-5583-4489-8a87-574e49fa6b66 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:46.334413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-854020cb-fd1b-4166-9f78-9b2917b60976 req-dd3a85ef-5583-4489-8a87-574e49fa6b66 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:46.334848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-854020cb-fd1b-4166-9f78-9b2917b60976 req-dd3a85ef-5583-4489-8a87-574e49fa6b66 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:46.346064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-854020cb-fd1b-4166-9f78-9b2917b60976 req-dd3a85ef-5583-4489-8a87-574e49fa6b66 service nova] Creating event network-vif-plugged:d99b9889-a89e-4be4-a2ab-7dfb4d184542 for instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 on hv-cinder-85367 Aug 18 17:24:46.351167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-854020cb-fd1b-4166-9f78-9b2917b60976 req-dd3a85ef-5583-4489-8a87-574e49fa6b66 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031915 Aug 18 17:24:46.351754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 478/977] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:24:46.706105 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:46.706717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:46.712840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:46.713708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:46.714211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:46.714964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:46.715454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:46.715878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:46.847413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:46.855503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ae39ad04-e427-4ee8-8238-19ff65b3dd42 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.153243 Aug 18 17:24:46.856068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 500/978] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:46 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:47.877540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:47.878235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:47.884445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:47.885735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:47.886204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:47.886921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:47.887418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:47.887848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:48.016595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:48.024208 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-eda7b92d-bd3a-4685-afa3-05b5e99f45e6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1364 microversion: 2.1 time: 0.151338 Aug 18 17:24:48.024713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 479/979] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:47 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:49.044575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:49.045190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:49.051635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:49.052115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:49.052546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:49.053234 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:49.053685 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:49.054107 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:49.184813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:24:49.192630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-44bbe386-a3a6-40ef-93b9-b46fde5a23f0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1553 microversion: 2.1 time: 0.151909 Aug 18 17:24:49.193194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 501/980] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:24:49 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:24:49.213457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:24:49.214002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:24:49.220356 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:49.220824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:49.221250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:49.221936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:49.222384 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:49.222803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:49.304441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3393e95c-268b-4b45-a250-28acbe911344 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093081 Aug 18 17:24:49.304441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 480/981] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:24:49 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:24:50.260906 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-d04615fa-11e8-4489-8983-83cfbb080902 req-8ebf3ff6-82d1-4219-b2a6-0e168e9d37cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcb74ce-bd3d-4943-9d28-4159511befb7", "tag": "d99b9889-a89e-4be4-a2ab-7dfb4d184542"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:24:50.270601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-d04615fa-11e8-4489-8983-83cfbb080902 req-8ebf3ff6-82d1-4219-b2a6-0e168e9d37cc service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:24:50.271122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-d04615fa-11e8-4489-8983-83cfbb080902 req-8ebf3ff6-82d1-4219-b2a6-0e168e9d37cc service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:24:50.271561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-d04615fa-11e8-4489-8983-83cfbb080902 req-8ebf3ff6-82d1-4219-b2a6-0e168e9d37cc service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:24:50.283146 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-d04615fa-11e8-4489-8983-83cfbb080902 req-8ebf3ff6-82d1-4219-b2a6-0e168e9d37cc service nova] Creating event network-changed:d99b9889-a89e-4be4-a2ab-7dfb4d184542 for instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 on hv-cinder-85367 Aug 18 17:24:50.289366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-d04615fa-11e8-4489-8983-83cfbb080902 req-8ebf3ff6-82d1-4219-b2a6-0e168e9d37cc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032203 Aug 18 17:24:50.289943 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 502/982] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:25:48.078388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=11 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:25:48.079658 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=38 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:25:48.081574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=11 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:25:48.082451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=31 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:25:48.083980 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:48.084717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:48.091031 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.096542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.096542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.096542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.096542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.096892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.122623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:25:48.156815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-c321d2f5-fec5-4ed1-8a44-432fb687d103 req-271fafff-403e-4d31-ab64-902bfdda4431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a70040-3d92-4837-8631-50a5dc77cb53", "tag": "3396a21f-3273-4ff1-8309-fb5e294ebdc8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:25:48.167057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-c321d2f5-fec5-4ed1-8a44-432fb687d103 req-271fafff-403e-4d31-ab64-902bfdda4431 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.167536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-c321d2f5-fec5-4ed1-8a44-432fb687d103 req-271fafff-403e-4d31-ab64-902bfdda4431 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.167959 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-c321d2f5-fec5-4ed1-8a44-432fb687d103 req-271fafff-403e-4d31-ab64-902bfdda4431 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.178795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-c321d2f5-fec5-4ed1-8a44-432fb687d103 req-271fafff-403e-4d31-ab64-902bfdda4431 service nova] Creating event network-changed:3396a21f-3273-4ff1-8309-fb5e294ebdc8 for instance a9a70040-3d92-4837-8631-50a5dc77cb53 on hv-cinder-85367 Aug 18 17:25:48.184991 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-c321d2f5-fec5-4ed1-8a44-432fb687d103 req-271fafff-403e-4d31-ab64-902bfdda4431 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105432 Aug 18 17:25:48.185630 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 503/983] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:25:48.403036 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:48.405294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:48.412201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.413201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.413698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.414417 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.414961 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.415695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.436560 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b9527d84-05d5-4fd9-be22-915100d92e18 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 204 len: 0 microversion: 2.1 time: 0.359665 Aug 18 17:25:48.437375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 481/984] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:25:48 2022] DELETE /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:25:48.446234 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:48.451122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:48.454767 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.455644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.456302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.457334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.457933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.459232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.468885 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ed653259-4c2e-4608-a9dd-58a448018fe2 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070811 Aug 18 17:25:48.474918 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 504/985] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:25:48 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 17:25:48.542839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:48.550394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:48.550394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.550394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.550977 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.551691 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.552145 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.552574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.579361 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Going to try to terminate instance {{(pid=121216) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:25:48.615336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:48.624145 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8240cd6f-7b84-42d4-ac3d-f95853c690ae tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1577 microversion: 2.1 time: 0.182159 Aug 18 17:25:48.628498 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 482/986] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:48 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:25:48.779658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2ef44ecf-8a77-4efa-a85d-3c1404416b78 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 204 len: 0 microversion: 2.1 time: 0.240905 Aug 18 17:25:48.780251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 505/987] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:25:48 2022] DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:25:48.788798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:48.794073 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:48.796448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.796940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.797526 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.798238 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:48.798696 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:48.799151 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:48.931888 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:48.940159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-26522d29-7602-4133-b7be-3e7462afdaaf tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1673 microversion: 2.1 time: 0.155457 Aug 18 17:25:48.940765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 483/988] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:48 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:49.771481 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:49.772187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:49.778276 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:49.778759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:49.779262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:49.779927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:49.780381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:49.780810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:49.912622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:49.920922 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3d43a674-106a-4a9b-b765-570ccb45a35d tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1577 microversion: 2.1 time: 0.280095 Aug 18 17:25:49.921489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 506/989] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:49 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1577 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:49.960994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:49.961606 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:49.968340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:49.968820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:49.969253 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:49.969943 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:49.970398 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:49.970822 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:50.103830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:50.112454 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9fb32fa2-2126-46a9-a9b8-ef6dcd7b2df8 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1673 microversion: 2.1 time: 0.155300 Aug 18 17:25:50.113025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 484/990] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:49 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:50.721937 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:25:50.722201 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Thu Aug 18 17:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:25:50.944135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:50.944749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:50.952276 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:50.952762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:50.953202 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:50.953891 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:50.954345 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:50.954771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:51.082482 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:51.090754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c1da8d17-90be-40ab-aed0-8dc4771e0ff3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1577 microversion: 2.1 time: 0.150537 Aug 18 17:25:51.091347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 507/991] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:50 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:51.133477 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:51.134120 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:51.141034 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:51.141559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:51.142004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:51.142701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:51.143189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:51.143621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:51.274982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:51.284740 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7471d19a-bb2e-47ac-8154-0c7010a7cba9 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1673 microversion: 2.1 time: 0.155047 Aug 18 17:25:51.295159 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 485/992] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:51 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:52.112618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:52.113334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:52.120424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:52.120939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:52.121438 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:52.122135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:52.122589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:52.123039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:52.308223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:52.308883 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:52.315698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:52.316185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:52.316625 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:52.317333 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:52.317793 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:52.318232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:52.473373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:52.482044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-db1f03b5-44dd-4a0d-aaf2-57bb3967bf86 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1458 microversion: 2.1 time: 0.373247 Aug 18 17:25:52.482618 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 508/993] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:52 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1458 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:52.631870 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:52.640002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0f0f2f27-8349-4309-b21d-6e5355fc3252 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1673 microversion: 2.1 time: 0.336179 Aug 18 17:25:52.640572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 486/994] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:52 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1673 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:25:52.939359 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-f4793b41-da67-4564-ab2d-2fe488da4ae0 req-fdf8b776-ea46-4d72-af54-fb4ebf28f7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a70040-3d92-4837-8631-50a5dc77cb53", "name": "network-vif-deleted", "tag": "3396a21f-3273-4ff1-8309-fb5e294ebdc8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:25:52.949708 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f4793b41-da67-4564-ab2d-2fe488da4ae0 req-fdf8b776-ea46-4d72-af54-fb4ebf28f7b2 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:52.950180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f4793b41-da67-4564-ab2d-2fe488da4ae0 req-fdf8b776-ea46-4d72-af54-fb4ebf28f7b2 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:52.950607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f4793b41-da67-4564-ab2d-2fe488da4ae0 req-fdf8b776-ea46-4d72-af54-fb4ebf28f7b2 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:52.964406 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-f4793b41-da67-4564-ab2d-2fe488da4ae0 req-fdf8b776-ea46-4d72-af54-fb4ebf28f7b2 service nova] Creating event network-vif-deleted:3396a21f-3273-4ff1-8309-fb5e294ebdc8 for instance a9a70040-3d92-4837-8631-50a5dc77cb53 on hv-cinder-85367 Aug 18 17:25:52.969547 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-f4793b41-da67-4564-ab2d-2fe488da4ae0 req-fdf8b776-ea46-4d72-af54-fb4ebf28f7b2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Aug 18 17:25:52.970137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 509/995] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:25:53.504667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:53.507964 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:53.516837 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:53.517343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:53.517785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:53.518515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:53.519014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:53.519452 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:53.595067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:53.604645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e7d8e582-53c2-40fd-8aa5-7c3ae2e15908 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 200 len: 1225 microversion: 2.1 time: 0.103209 Aug 18 17:25:53.615515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 487/996] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:53 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:53.663092 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:53.663940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:53.670728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:53.671258 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:53.671678 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:53.672370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:53.672822 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:53.673244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:53.708528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:53.708932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:53.709364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:53.709809 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lazy-loading 'fault' on Instance uuid f25511a4-8386-4e28-af43-fd634d160293 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:25:53.772488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:53.781194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5544e693-e1b8-41ea-b157-7ecc3526f562 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 200 len: 1327 microversion: 2.1 time: 0.123033 Aug 18 17:25:53.781761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 510/997] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:53 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:54.626446 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:54.627021 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: a9a70040-3d92-4837-8631-50a5dc77cb53] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:54.633536 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:54.634017 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:54.634455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:54.635821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:54.636382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:54.636811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:54.650413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] HTTP exception thrown: Instance a9a70040-3d92-4837-8631-50a5dc77cb53 could not be found. Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Request method failure captured: Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 HTTP/1.1 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nO8YRAD-VPGAmg2nioUy6no7hOCLDRYlDkpSuQDV8IciyNq8MYgc_Kt9lDpkiyS_jAfzNHk0QFhggqiH626PHXaebgwD4ws7nnKUoEqJXUI-4pdn6a3keKpX6CYqA3JvFgCgY7dzA4vM94QK58YLuZZe7mYdFXabv-p45LsM1Dvxw8 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:25:54.655414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 04ab53c336934355a0000bda59fa7e7c Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance a9a70040-3d92-4837-8631-50a5dc77cb53 could not be found. Aug 18 17:25:54.656885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'a9a70040-3d92-4837-8631-50a5dc77cb53'} Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a70040-3d92-4837-8631-50a5dc77cb53 could not be found. Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:25:54.657659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a70040-3d92-4837-8631-50a5dc77cb53 could not be found. Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a70040-3d92-4837-8631-50a5dc77cb53 could not be found. Aug 18 17:25:54.659350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.660735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Returning 404 to user: Instance a9a70040-3d92-4837-8631-50a5dc77cb53 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:25:54.660735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ecb2023c-5b70-4df3-bf85-5fe98d4759c1 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53" status: 404 len: 111 microversion: 2.1 time: 0.031349 Aug 18 17:25:54.660735 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 488/998] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:54 2022] GET /compute/v2.1/servers/a9a70040-3d92-4837-8631-50a5dc77cb53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:25:54.804311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:54.804915 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:54.811661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:54.812134 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:54.812565 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:54.813501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:54.813946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:54.814370 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:54.829300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] HTTP exception thrown: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Request method failure captured: Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 HTTP/1.1 Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nT5RIVg-2_fPrks_NR42en54olELXuTQiUdrxg4nDcyHjLB1XxNR_0wIDuSdEa9I8OirP-alh1lIdyrGMXdSl0XHv1U-P5c8dFdpI79qpXkZSy0wDEb5_85hVi6h-tq5Wnid3942RqgPdl6nT5bsz4YbNPlpdkOKcs-SBAX5NzNJXs Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:25:54.831157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: c5796bbaaf1345b6867d3cd5082f75b0 Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:25:54.832764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'f25511a4-8386-4e28-af43-fd634d160293'} Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:25:54.833862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:25:54.835364 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:25:54.836632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Returning 404 to user: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:25:54.836632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0c71e80c-2326-4493-8cf9-eaeec2fbd567 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 404 len: 111 microversion: 2.1 time: 0.032322 Aug 18 17:25:54.836632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 511/999] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:54 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:25:54.842474 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f82688e7-fd43-4c6b-b7fb-2fc8ebbd0383 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '.version_select at 0x7fd1f36f99d0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:54.923216 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f82688e7-fd43-4c6b-b7fb-2fc8ebbd0383 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314215007" status: 202 len: 0 microversion: 2.1 time: 0.085056 Aug 18 17:25:54.923713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 489/1000] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 17:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314215007 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:25:54.989448 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-dfef45cc-9136-499e-9649-c21a934c56fc req-22f958cf-1009-40f8-801d-892ffa6b3ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25511a4-8386-4e28-af43-fd634d160293", "name": "network-vif-deleted", "tag": "f2d34da6-7a98-4f76-8518-486441b45056"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:25:54.999178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-dfef45cc-9136-499e-9649-c21a934c56fc req-22f958cf-1009-40f8-801d-892ffa6b3ded service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:54.999646 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-dfef45cc-9136-499e-9649-c21a934c56fc req-22f958cf-1009-40f8-801d-892ffa6b3ded service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:55.000103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-dfef45cc-9136-499e-9649-c21a934c56fc req-22f958cf-1009-40f8-801d-892ffa6b3ded service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:55.011211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-dfef45cc-9136-499e-9649-c21a934c56fc req-22f958cf-1009-40f8-801d-892ffa6b3ded service nova] Creating event network-vif-deleted:f2d34da6-7a98-4f76-8518-486441b45056 for instance f25511a4-8386-4e28-af43-fd634d160293 on hv-cinder-85367 Aug 18 17:25:55.016413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-dfef45cc-9136-499e-9649-c21a934c56fc req-22f958cf-1009-40f8-801d-892ffa6b3ded service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Aug 18 17:25:55.016994 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 512/1001] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:25:55.659656 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1ad0548a-f38c-4cc8-94e6-5812a7f8a15e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: .version_select at 0x7fd1f2ce2af0>, body: {"keypair": {"name": "tempest-keypair-1613115737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBh4y/FEH6fms7zDIhsvubqPhTkysY6FkDU/RnBvQGSqjwBVkKQFn4xdW8biip8fuv/5lKbz39CbxYTt/m6yYI3KcaM4CdnaK78ZhtKrLWH3ReGMqjIUyW3HLXkgSSAfg=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:25:55.676397 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-1ad0548a-f38c-4cc8-94e6-5812a7f8a15e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for project b531205569ec466f8e1ce8ce05427663. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:25:55.680205 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-1ad0548a-f38c-4cc8-94e6-5812a7f8a15e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for user c5796bbaaf1345b6867d3cd5082f75b0 and project b531205569ec466f8e1ce8ce05427663. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:25:55.763811 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1ad0548a-f38c-4cc8-94e6-5812a7f8a15e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108114 Aug 18 17:25:55.764411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 490/1002] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:25:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:25:58.038283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1265145808", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f95bd5cc-1184-4613-8f77-dbd0ddb9712a"}], "security_groups": [{"name": "tempest-securitygroup--1702232646"}], "key_name": "tempest-keypair-1613115737", "user_data": "}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:25:58.209534 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] validate_networks() for [('f95bd5cc-1184-4613-8f77-dbd0ddb9712a', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:25:58.326211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:58.326727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:58.332967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.333464 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.333909 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.334616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.335106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.335534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.368150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:25:58.665012 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-825343ff-d857-4414-b9af-8761b5d81284 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 204 len: 0 microversion: 2.1 time: 0.344031 Aug 18 17:25:58.665631 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 491/1003] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:25:58 2022] DELETE /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:25:58.673609 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-e28d0999-aeea-44eb-8fdb-a811843be44f req-804c07fd-8347-4668-8d4b-2f6e8b60658c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0f71e4-16c3-46fb-9f83-612c29210afb", "tag": "908c5bf5-4e23-4b54-a0e1-d6557f5c1217"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:25:58.684139 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e28d0999-aeea-44eb-8fdb-a811843be44f req-804c07fd-8347-4668-8d4b-2f6e8b60658c service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.684610 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e28d0999-aeea-44eb-8fdb-a811843be44f req-804c07fd-8347-4668-8d4b-2f6e8b60658c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.685287 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-e28d0999-aeea-44eb-8fdb-a811843be44f req-804c07fd-8347-4668-8d4b-2f6e8b60658c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.690284 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:25:58.690967 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:25:58.691586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:25:58.692209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:25:58.692938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:25:58.697186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-e28d0999-aeea-44eb-8fdb-a811843be44f req-804c07fd-8347-4668-8d4b-2f6e8b60658c service nova] Creating event network-changed:908c5bf5-4e23-4b54-a0e1-d6557f5c1217 for instance 9e0f71e4-16c3-46fb-9f83-612c29210afb on hv-cinder-85367 Aug 18 17:25:58.702197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.702520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-e28d0999-aeea-44eb-8fdb-a811843be44f req-804c07fd-8347-4668-8d4b-2f6e8b60658c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Aug 18 17:25:58.703059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.703198 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 492/1004] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:25:58.703574 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.704637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.706367 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.707235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.708272 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:58.709138 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:58.716401 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.716808 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.717511 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.718209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:58.718836 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:58.719375 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:58.726738 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for project b531205569ec466f8e1ce8ce05427663. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:25:58.731648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Getting quotas for user c5796bbaaf1345b6867d3cd5082f75b0 and project b531205569ec466f8e1ce8ce05427663. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:25:58.743343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:25:58.746652 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:25:58.861413 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:58.869424 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-02354692-5a6d-4606-b8a3-f5c2139c2ea7 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1576 microversion: 2.1 time: 0.164964 Aug 18 17:25:58.870500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 493/1005] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:58 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:58.948672 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e9da1df0-8340-4bd9-9fd8-9edfcaad4144 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.963808 Aug 18 17:25:58.949352 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 513/1006] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:25:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:25:58.960082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3432b357-30b4-4db4-87ba-3c4009911d03 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:58.960697 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3432b357-30b4-4db4-87ba-3c4009911d03 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:59.023394 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3432b357-30b4-4db4-87ba-3c4009911d03 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:25:59.031921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3432b357-30b4-4db4-87ba-3c4009911d03 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1238 microversion: 2.1 time: 0.075594 Aug 18 17:25:59.032497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 494/1007] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:58 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:25:59.891785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:25:59.892392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:25:59.899126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:59.899602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:59.900033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:25:59.900913 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:25:59.901546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:25:59.901970 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:00.052202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:00.052809 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:00.060292 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:00.060772 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:00.061208 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:00.061900 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:00.062357 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:00.062775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:00.072611 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:00.081382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5d4aeb35-936b-49d9-a988-87f91dcbf864 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1576 microversion: 2.1 time: 0.193869 Aug 18 17:26:00.082161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 514/1008] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:25:59 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:00.125410 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:00.133091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7a005f37-0d5b-4c22-b3c6-66b99e21bde3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1242 microversion: 2.1 time: 0.084694 Aug 18 17:26:00.133809 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 495/1009] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:00 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:26:00.950709 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-3cee5fc1-44e5-4afe-b82b-5d1642c59356 req-f0d183c6-d9a1-4f0f-a7ca-cc91bca51621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0f71e4-16c3-46fb-9f83-612c29210afb", "name": "network-vif-deleted", "tag": "908c5bf5-4e23-4b54-a0e1-d6557f5c1217"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:00.960784 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-3cee5fc1-44e5-4afe-b82b-5d1642c59356 req-f0d183c6-d9a1-4f0f-a7ca-cc91bca51621 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:00.961261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-3cee5fc1-44e5-4afe-b82b-5d1642c59356 req-f0d183c6-d9a1-4f0f-a7ca-cc91bca51621 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:00.961693 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-3cee5fc1-44e5-4afe-b82b-5d1642c59356 req-f0d183c6-d9a1-4f0f-a7ca-cc91bca51621 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:00.973318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-3cee5fc1-44e5-4afe-b82b-5d1642c59356 req-f0d183c6-d9a1-4f0f-a7ca-cc91bca51621 service nova] Creating event network-vif-deleted:908c5bf5-4e23-4b54-a0e1-d6557f5c1217 for instance 9e0f71e4-16c3-46fb-9f83-612c29210afb on hv-cinder-85367 Aug 18 17:26:00.978415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-3cee5fc1-44e5-4afe-b82b-5d1642c59356 req-f0d183c6-d9a1-4f0f-a7ca-cc91bca51621 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031809 Aug 18 17:26:00.980044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 515/1010] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:26:01.112240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:01.113812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:01.121387 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:01.122435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:01.123148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:01.124199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:01.124956 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:01.126086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:01.157169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:01.158268 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:01.166778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:01.167298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:01.167901 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:01.168727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:01.169192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:01.169654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:01.218471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ab53c336934355a0000bda59fa7e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976b3d87de347818a3c62fa4806db98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:01.227924 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9b5879e2-edde-4a8f-8cca-4835dff6f61f tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 200 len: 1224 microversion: 2.1 time: 0.120829 Aug 18 17:26:01.228645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 496/1011] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:01 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:01.255760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:01.266301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cd7084cc-e1c3-478d-aeb4-b9d50e5dc184 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1308 microversion: 2.1 time: 0.116545 Aug 18 17:26:01.267363 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 516/1012] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:01 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:26:02.250252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:02.250824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 9e0f71e4-16c3-46fb-9f83-612c29210afb] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:02.258471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.260026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.260761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.261624 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.262079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.262505 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.279393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] HTTP exception thrown: Instance 9e0f71e4-16c3-46fb-9f83-612c29210afb could not be found. Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Request method failure captured: Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb HTTP/1.1 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nO8YRAD-VPGAmg2nioUy6no7hOCLDRYlDkpSuQDV8IciyNq8MYgc_Kt9lDpkiyS_jAfzNHk0QFhggqiH626PHXaebgwD4ws7nnKUoEqJXUI-4pdn6a3keKpX6CYqA3JvFgCgY7dzA4vM94QK58YLuZZe7mYdFXabv-p45LsM1Dvxw8 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:26:02.281050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 04ab53c336934355a0000bda59fa7e7c Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 9e0f71e4-16c3-46fb-9f83-612c29210afb could not be found. Aug 18 17:26:02.282539 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '9e0f71e4-16c3-46fb-9f83-612c29210afb'} Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0f71e4-16c3-46fb-9f83-612c29210afb could not be found. Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:26:02.283453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0f71e4-16c3-46fb-9f83-612c29210afb could not be found. Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0f71e4-16c3-46fb-9f83-612c29210afb could not be found. Aug 18 17:26:02.285036 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.286522 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Returning 404 to user: Instance 9e0f71e4-16c3-46fb-9f83-612c29210afb could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:26:02.286522 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f7bd47bc-5ff8-4d8c-a147-b95dc4db60c3 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb" status: 404 len: 111 microversion: 2.1 time: 0.036226 Aug 18 17:26:02.286522 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 497/1013] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:02 2022] GET /compute/v2.1/servers/9e0f71e4-16c3-46fb-9f83-612c29210afb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:26:02.298531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:02.303141 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:02.305610 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.306082 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.306508 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.307570 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.308100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.308520 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.540059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:02.551597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-51e18e45-c768-453a-ac17-e597684de2fb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.263683 Aug 18 17:26:02.552546 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 517/1014] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:02 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:02.798927 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:02.799436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:02.805360 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.805842 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.806276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.807602 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.808056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.808658 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.822342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] HTTP exception thrown: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Request method failure captured: Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 HTTP/1.1 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nO8YRAD-VPGAmg2nioUy6no7hOCLDRYlDkpSuQDV8IciyNq8MYgc_Kt9lDpkiyS_jAfzNHk0QFhggqiH626PHXaebgwD4ws7nnKUoEqJXUI-4pdn6a3keKpX6CYqA3JvFgCgY7dzA4vM94QK58YLuZZe7mYdFXabv-p45LsM1Dvxw8 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:26:02.823967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: 04ab53c336934355a0000bda59fa7e7c Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.825548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '1732a5ad-82ea-4429-ab40-0dd58302edd8'} Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:26:02.826499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.827855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.829302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Returning 404 to user: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:26:02.829302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-72339824-b051-429c-9d1d-b763cc34be98 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 404 len: 111 microversion: 2.1 time: 0.031800 Aug 18 17:26:02.829302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 498/1015] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:26:02 2022] DELETE /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:26:02.834317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:02.834958 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] [instance: 1732a5ad-82ea-4429-ab40-0dd58302edd8] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:02.841272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.841744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.842185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.842888 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:02.843376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:02.843801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:02.858232 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] HTTP exception thrown: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Request method failure captured: Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 HTTP/1.1 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nO8YRAD-VPGAmg2nioUy6no7hOCLDRYlDkpSuQDV8IciyNq8MYgc_Kt9lDpkiyS_jAfzNHk0QFhggqiH626PHXaebgwD4ws7nnKUoEqJXUI-4pdn6a3keKpX6CYqA3JvFgCgY7dzA4vM94QK58YLuZZe7mYdFXabv-p45LsM1Dvxw8 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:26:02.859983 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e976b3d87de347818a3c62fa4806db98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: e976b3d87de347818a3c62fa4806db98 Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238686354 Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 04ab53c336934355a0000bda59fa7e7c Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-TestVolumeBootPattern-1238686354-project Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.861571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '1732a5ad-82ea-4429-ab40-0dd58302edd8'} Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:26:02.862453 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. Aug 18 17:26:02.863653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:26:02.864871 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Returning 404 to user: Instance 1732a5ad-82ea-4429-ab40-0dd58302edd8 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:26:02.864871 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fb5d7050-8ae6-4c03-a47a-3bacef821d00 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8" status: 404 len: 111 microversion: 2.1 time: 0.031194 Aug 18 17:26:02.864871 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 518/1016] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:02 2022] GET /compute/v2.1/servers/1732a5ad-82ea-4429-ab40-0dd58302edd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:26:03.030117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-bb94aecf-1c63-4cca-985f-4c2e9d05f86f req-5e3ec31d-d38a-4e51-9d35-0466802cb146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f743d974-14ac-4415-a8e4-b18a8b6fce19", "tag": "7f1d0cf1-d3f0-4693-b241-55d0e47a09d8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:03.041033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-bb94aecf-1c63-4cca-985f-4c2e9d05f86f req-5e3ec31d-d38a-4e51-9d35-0466802cb146 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:03.041033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-bb94aecf-1c63-4cca-985f-4c2e9d05f86f req-5e3ec31d-d38a-4e51-9d35-0466802cb146 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:03.041552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-bb94aecf-1c63-4cca-985f-4c2e9d05f86f req-5e3ec31d-d38a-4e51-9d35-0466802cb146 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:03.053444 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-bb94aecf-1c63-4cca-985f-4c2e9d05f86f req-5e3ec31d-d38a-4e51-9d35-0466802cb146 service nova] Creating event network-changed:7f1d0cf1-d3f0-4693-b241-55d0e47a09d8 for instance f743d974-14ac-4415-a8e4-b18a8b6fce19 on hv-cinder-85367 Aug 18 17:26:03.059400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-bb94aecf-1c63-4cca-985f-4c2e9d05f86f req-5e3ec31d-d38a-4e51-9d35-0466802cb146 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033684 Aug 18 17:26:03.060332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 499/1017] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:03.574314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:03.574937 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:03.581323 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:03.581801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:03.582239 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:03.582963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:03.583421 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:03.583848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:03.715446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:03.722939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ade5475b-0813-4571-abea-47c876a075af tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.153051 Aug 18 17:26:03.723491 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 519/1018] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:03 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:04.322046 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6b71aefa-ae9b-4b3c-9523-b976b674bc23 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] Calling method '.version_select at 0x7fd1f2bf11f0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:04.409167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6b71aefa-ae9b-4b3c-9523-b976b674bc23 tempest-TestVolumeBootPattern-1238686354 tempest-TestVolumeBootPattern-1238686354-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-959238922" status: 202 len: 0 microversion: 2.1 time: 0.091719 Aug 18 17:26:04.409756 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 500/1019] 10.222.0.82 () {58 vars in 1260 bytes} [Thu Aug 18 17:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-959238922 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:26:04.743858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:04.745083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:04.751813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:04.752428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:04.752862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:04.753568 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:04.754022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:04.754446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:04.887946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:04.895761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b0273954-aa34-47cd-8a95-272462a12ac6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.155824 Aug 18 17:26:04.896415 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 520/1020] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:04 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:05.917751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:05.918487 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:05.925578 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:05.926065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:05.926492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:05.927221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:05.927676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:05.928094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:05.948759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:06.065911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:06.073779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-96b2b9f5-98c8-481c-87d1-1bf8d7c6e291 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.160547 Aug 18 17:26:06.074343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 501/1021] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:05 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:07.097481 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:07.098156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:07.105559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:07.106449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:07.107253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:07.108123 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:07.108727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:07.109509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:07.308653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:07.317373 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-14287f84-a5c7-4730-a214-0fdf672911d6 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.223830 Aug 18 17:26:07.321215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 521/1022] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:07 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:08.339842 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:08.340482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:08.347285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:08.347769 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:08.348206 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:08.348892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:08.349342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:08.349762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:08.486838 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:08.494929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0a0cd77d-65cc-4c0d-96ad-c38ea0598501 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.159160 Aug 18 17:26:08.498348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 502/1023] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:08 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:08.704848 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-88dad13e-80af-4540-a528-4eaca061fc09 req-eab56b14-1ae4-4433-914f-0be2d0b9f3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f743d974-14ac-4415-a8e4-b18a8b6fce19", "name": "network-vif-plugged", "status": "completed", "tag": "7f1d0cf1-d3f0-4693-b241-55d0e47a09d8"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:08.715065 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-88dad13e-80af-4540-a528-4eaca061fc09 req-eab56b14-1ae4-4433-914f-0be2d0b9f3c7 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:08.715679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-88dad13e-80af-4540-a528-4eaca061fc09 req-eab56b14-1ae4-4433-914f-0be2d0b9f3c7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:08.716113 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-88dad13e-80af-4540-a528-4eaca061fc09 req-eab56b14-1ae4-4433-914f-0be2d0b9f3c7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:08.719916 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:08.720564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:08.727613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-88dad13e-80af-4540-a528-4eaca061fc09 req-eab56b14-1ae4-4433-914f-0be2d0b9f3c7 service nova] Creating event network-vif-plugged:7f1d0cf1-d3f0-4693-b241-55d0e47a09d8 for instance f743d974-14ac-4415-a8e4-b18a8b6fce19 on hv-cinder-85367 Aug 18 17:26:08.733233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-88dad13e-80af-4540-a528-4eaca061fc09 req-eab56b14-1ae4-4433-914f-0be2d0b9f3c7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Aug 18 17:26:08.733812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 522/1024] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:26:09.515729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:09.516363 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:09.518256 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:09.523440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:09.523917 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:09.524350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:09.525048 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:09.526246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:09.526849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:09.662745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:09.670674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b45df0bf-8bc3-4471-81fd-847813cd17ee tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.158819 Aug 18 17:26:09.671300 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 503/1025] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:09 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:10.689188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:10.694865 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:10.695629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:10.703795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:10.704296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:10.704723 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:10.705422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:10.706079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:10.706501 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:10.850048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:10.861022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1c5a8fde-65a3-4072-aaae-91c0b117ac2a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1364 microversion: 2.1 time: 0.172799 Aug 18 17:26:10.861827 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 523/1026] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:10 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:11.888308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:11.889213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:11.895858 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:11.896372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:11.896809 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:11.897516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:11.897970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:11.898396 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:12.037797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:12.043447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-21a52bd5-5382-435a-9101-e361dbfb0ba3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1550 microversion: 2.1 time: 0.159219 Aug 18 17:26:12.044032 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 504/1027] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:11 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:12.073336 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:12.073813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:12.080270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:12.080769 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:12.081185 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:12.081875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:12.082330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:12.082754 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:12.159801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-001185e4-2423-4527-87ef-267afcd0e06a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090327 Aug 18 17:26:12.160889 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 524/1028] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:26:12 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:13.450285 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-c48e4a4a-5664-4848-ac48-42492e88a762 req-47d045cd-0dac-4533-8ab5-8b310f77f136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f743d974-14ac-4415-a8e4-b18a8b6fce19", "tag": "7f1d0cf1-d3f0-4693-b241-55d0e47a09d8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:13.461318 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c48e4a4a-5664-4848-ac48-42492e88a762 req-47d045cd-0dac-4533-8ab5-8b310f77f136 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:13.461967 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c48e4a4a-5664-4848-ac48-42492e88a762 req-47d045cd-0dac-4533-8ab5-8b310f77f136 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:13.462701 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c48e4a4a-5664-4848-ac48-42492e88a762 req-47d045cd-0dac-4533-8ab5-8b310f77f136 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:13.475934 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-c48e4a4a-5664-4848-ac48-42492e88a762 req-47d045cd-0dac-4533-8ab5-8b310f77f136 service nova] Creating event network-changed:7f1d0cf1-d3f0-4693-b241-55d0e47a09d8 for instance f743d974-14ac-4415-a8e4-b18a8b6fce19 on hv-cinder-85367 Aug 18 17:26:13.483293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-c48e4a4a-5664-4848-ac48-42492e88a762 req-47d045cd-0dac-4533-8ab5-8b310f77f136 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036865 Aug 18 17:26:13.484499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 505/1029] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:16.669845 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:16.670391 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:16.676334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:16.676818 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:16.677253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:16.677939 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:16.678389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:16.678811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:16.705159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-591f7d47-e2b7-4434-a634-f3936d8559e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/ips" status: 200 len: 149 microversion: 2.1 time: 0.039717 Aug 18 17:26:16.705717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 525/1030] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:26:16 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:19.444254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2677db1-c6fb-49ae-a8ab-12aeb265fff6"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:19.446655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:19.449182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:19.454094 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:19.454580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:19.455061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:19.455765 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:19.456221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:19.456655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:20.085588 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-066e18eb-162a-45bf-acb1-aab69cf73510 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645392 Aug 18 17:26:20.086190 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 506/1031] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:26:19 2022] POST /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:27.610187 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2205c957-af88-4966-9d7e-50d73e3bbd3d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: .version_select at 0x7fd1fb525790>, body: {"keypair": {"name": "tempest-keypair-2004870675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGuwcXYhh4jrPVRaKdFgnHeibgYFvXOZGFtyAjepapMGJjDxMlzcQrsWD8G+zePVgMqyHDiKcLQgExR+P7oXGsKs0aYsLOvxfS8aF7iustyWeDXboSlrouhGXK4QMuZpg=="}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:27.615788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:27.616455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=14 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:27.627726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-2205c957-af88-4966-9d7e-50d73e3bbd3d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:26:27.631622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-2205c957-af88-4966-9d7e-50d73e3bbd3d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:26:27.705198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2205c957-af88-4966-9d7e-50d73e3bbd3d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098870 Aug 18 17:26:27.705783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 526/1032] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:26:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:29.729644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-356661735", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3c0c0db-a3aa-43d0-b2aa-cb12907841f7"}], "security_groups": [{"name": "tempest-securitygroup--538167774"}], "key_name": "tempest-keypair-2004870675", "user_data": "}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:29.738653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:29.837761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] validate_networks() for [('b3c0c0db-a3aa-43d0-b2aa-cb12907841f7', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:26:30.003549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:30.309739 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:26:30.310162 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:26:30.310635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:26:30.311364 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:26:30.311785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:26:30.321305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:30.321781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:30.322213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:30.322960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:30.323434 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:30.323855 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:30.340812 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:26:30.345437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:26:30.356668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:26:30.359280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:26:30.543834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7663b333-b450-4339-8d42-282f3a2b5062 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.818744 Aug 18 17:26:30.544482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 507/1033] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:26:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:26:30.555691 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e6c4abed-3012-4afa-b719-669248c4416d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:30.556312 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e6c4abed-3012-4afa-b719-669248c4416d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:30.612083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e6c4abed-3012-4afa-b719-669248c4416d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:30.620762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e6c4abed-3012-4afa-b719-669248c4416d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1241 microversion: 2.1 time: 0.069335 Aug 18 17:26:30.621341 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 527/1034] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:30 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:31.642213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:31.643040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:31.650178 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:31.650654 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:31.651117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:31.651801 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:31.652246 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:31.652666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:31.713963 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:31.722193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c6f002d9-944b-489d-8bdc-ca13959a201a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1237 microversion: 2.1 time: 0.084485 Aug 18 17:26:31.722745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 508/1035] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:31 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:26:32.743714 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:32.744322 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:32.751786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:32.752398 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:32.752838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:32.753538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:32.753986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:32.754407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:32.826142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:32.834067 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3a7696b4-019e-497b-b46c-ceccb6e89ca2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1299 microversion: 2.1 time: 0.094778 Aug 18 17:26:32.834627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 528/1036] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:32 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:26:33.855813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:33.856340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:33.862868 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:33.863378 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:33.863839 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:33.864506 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:33.864957 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:33.865381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:34.002441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-e28082ed-a90e-4751-8d48-8d08b0b095d3 req-3a3548a3-ff9d-43c9-820b-6d1a443512bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec039f68-067d-4759-bbe9-fa09aadb69e6", "tag": "c955422f-dc01-4d56-8494-c725a5bb61df"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:34.012066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e28082ed-a90e-4751-8d48-8d08b0b095d3 req-3a3548a3-ff9d-43c9-820b-6d1a443512bc service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:34.012604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e28082ed-a90e-4751-8d48-8d08b0b095d3 req-3a3548a3-ff9d-43c9-820b-6d1a443512bc service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:34.013075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-e28082ed-a90e-4751-8d48-8d08b0b095d3 req-3a3548a3-ff9d-43c9-820b-6d1a443512bc service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:34.024799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-e28082ed-a90e-4751-8d48-8d08b0b095d3 req-3a3548a3-ff9d-43c9-820b-6d1a443512bc service nova] Creating event network-changed:c955422f-dc01-4d56-8494-c725a5bb61df for instance ec039f68-067d-4759-bbe9-fa09aadb69e6 on hv-cinder-85367 Aug 18 17:26:34.029763 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-e28082ed-a90e-4751-8d48-8d08b0b095d3 req-3a3548a3-ff9d-43c9-820b-6d1a443512bc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032238 Aug 18 17:26:34.030396 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 529/1037] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:34.052951 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:34.057245 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e0eb1920-a05d-4e2b-9fb2-fe7faefae303 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.205311 Aug 18 17:26:34.058161 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 509/1038] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:33 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:35.080571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:35.081277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:35.087503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:35.087986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:35.088427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:35.089121 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:35.089579 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:35.090005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:35.217730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:35.225176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-515f576e-5612-4e12-ad48-e18fe47460cd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.150102 Aug 18 17:26:35.225734 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 530/1039] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:35 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:36.245286 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:36.245908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:36.252948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:36.253431 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:36.253871 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:36.254572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:36.255180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:36.255612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:36.383231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:36.390713 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f611d933-c094-43a6-ace1-5b50be3f966b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.149400 Aug 18 17:26:36.391305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 510/1040] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:36 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:37.411343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:37.411969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:37.418351 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:37.418826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:37.419297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:37.419981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:37.420427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:37.420847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:37.553395 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:37.559005 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4299990b-492a-41b7-820f-86eb5b591713 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.151465 Aug 18 17:26:37.559509 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 531/1041] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:37 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:38.579961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:38.580594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:38.587764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:38.592918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:38.592918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:38.592918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:38.592918 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:38.593359 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:38.720342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:38.728623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e892f59e-38eb-4a75-862f-6e32f4370629 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.152388 Aug 18 17:26:38.729119 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 511/1042] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:38 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:39.749445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:39.751022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:39.757381 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:39.757856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:39.758285 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:39.758998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:39.759445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:39.759863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:39.902810 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:39.910671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-21443795-6417-45a8-b645-5d5018499bab tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.165039 Aug 18 17:26:39.911306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 532/1043] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:39 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:40.870620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-f8068f9f-8a50-44c6-8268-e3e23b138659 req-c1459cc7-efef-4514-ba66-95ca159ca404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec039f68-067d-4759-bbe9-fa09aadb69e6", "name": "network-vif-plugged", "status": "completed", "tag": "c955422f-dc01-4d56-8494-c725a5bb61df"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:40.876252 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:40.877187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:40.882311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-f8068f9f-8a50-44c6-8268-e3e23b138659 req-c1459cc7-efef-4514-ba66-95ca159ca404 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:40.882779 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-f8068f9f-8a50-44c6-8268-e3e23b138659 req-c1459cc7-efef-4514-ba66-95ca159ca404 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:40.883259 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-f8068f9f-8a50-44c6-8268-e3e23b138659 req-c1459cc7-efef-4514-ba66-95ca159ca404 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:40.894663 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-f8068f9f-8a50-44c6-8268-e3e23b138659 req-c1459cc7-efef-4514-ba66-95ca159ca404 service nova] Creating event network-vif-plugged:c955422f-dc01-4d56-8494-c725a5bb61df for instance ec039f68-067d-4759-bbe9-fa09aadb69e6 on hv-cinder-85367 Aug 18 17:26:40.899639 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-f8068f9f-8a50-44c6-8268-e3e23b138659 req-c1459cc7-efef-4514-ba66-95ca159ca404 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Aug 18 17:26:40.900211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 512/1044] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:40.932486 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:40.933661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:40.936113 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:40.942838 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:40.942991 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:40.943468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:40.944159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:40.944610 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:40.945063 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:41.091321 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:41.099864 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1c8ec759-b827-40cd-9fae-33bc9a917be5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.171476 Aug 18 17:26:41.100430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 533/1045] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:40 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:26:42.121997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:42.122703 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:42.129958 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:42.130441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:42.130886 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:42.131609 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:42.132063 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:42.132492 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:42.263354 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:42.271616 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f94c3cae-3100-49ac-a9e0-9e718192e2fd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1366 microversion: 2.1 time: 0.154372 Aug 18 17:26:42.272179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 513/1046] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:42 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:43.293115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:43.293720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:43.300327 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:43.300808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:43.301238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:43.302015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:43.302461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:43.302880 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:43.584172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:26:43.591759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ef5a3621-1061-497f-8077-f2f4034cd31b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1555 microversion: 2.1 time: 0.302628 Aug 18 17:26:43.592311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 534/1047] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:26:43 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1555 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:26:43.611724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:26:43.612225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:26:43.618542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:43.619059 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:43.619496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:43.620191 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:43.620645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:43.621070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:43.697840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-986e2514-4247-43ae-8da0-61f3d54489be tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090102 Aug 18 17:26:43.698460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 514/1048] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:26:43 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:26:44.686314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-f23982e6-b520-4717-8603-3a4cafbefdaf req-80ddda9b-1c51-4a43-9100-dc63741bf33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec039f68-067d-4759-bbe9-fa09aadb69e6", "tag": "c955422f-dc01-4d56-8494-c725a5bb61df"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:26:44.697227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f23982e6-b520-4717-8603-3a4cafbefdaf req-80ddda9b-1c51-4a43-9100-dc63741bf33f service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:26:44.697694 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f23982e6-b520-4717-8603-3a4cafbefdaf req-80ddda9b-1c51-4a43-9100-dc63741bf33f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:26:44.698115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-f23982e6-b520-4717-8603-3a4cafbefdaf req-80ddda9b-1c51-4a43-9100-dc63741bf33f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:26:44.709205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-f23982e6-b520-4717-8603-3a4cafbefdaf req-80ddda9b-1c51-4a43-9100-dc63741bf33f service nova] Creating event network-changed:c955422f-dc01-4d56-8494-c725a5bb61df for instance ec039f68-067d-4759-bbe9-fa09aadb69e6 on hv-cinder-85367 Aug 18 17:26:44.714326 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-f23982e6-b520-4717-8603-3a4cafbefdaf req-80ddda9b-1c51-4a43-9100-dc63741bf33f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 Aug 18 17:26:44.715039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 535/1049] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:28.237572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:27:28.238339 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=38 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:27:28.242234 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:28.242734 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:28.248521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:28.249002 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:28.249441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:28.250129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:28.251118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:28.260352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:28.274876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-550980bb-ab4d-42c7-90e8-8bfa09a4d52c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/ips" status: 200 len: 146 microversion: 2.1 time: 0.039114 Aug 18 17:27:28.275461 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 515/1050] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:27:28 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:29.817169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:27:29.817920 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=40 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:27:29.822260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4dcac88-7fa2-4092-87cc-2347a59de6fa"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:27:29.824653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:29.831023 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:29.835973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:29.835973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:29.835973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:29.835973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:29.836409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:30.627756 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2b12bb5e-127c-4da0-a716-28754f0dc7de tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811155 Aug 18 17:27:30.628366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 536/1051] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:27:29 2022] POST /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:38.146201 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:38.148494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:38.155821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:38.156303 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:38.156746 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:38.157440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:38.157896 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:38.158379 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:38.188447 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2a904a1c-fffa-4bde-8fed-971f02948c2b tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Aug 18 17:27:38.188998 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 516/1052] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:27:38 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:38.200504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:38.201076 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:38.208493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:38.213022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:38.213022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:38.213022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:38.213022 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:38.213433 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:38.238853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a990c974-23f3-427a-bee3-234cba8aaffb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/f4dcac88-7fa2-4092-87cc-2347a59de6fa" status: 200 len: 194 microversion: 2.1 time: 0.042617 Aug 18 17:27:38.239507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 537/1053] 10.222.0.82 () {58 vars in 1413 bytes} [Thu Aug 18 17:27:38 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/f4dcac88-7fa2-4092-87cc-2347a59de6fa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:39.803021 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f710ccb-4de5-41a5-b264-a2a87b7392f7"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:27:39.805668 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:39.812608 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:39.814456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:39.814456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:39.814456 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:39.814891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:39.815244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:40.518169 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1049edcd-2491-4220-8db3-c53ad71ea5ff tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "POST /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720113 Aug 18 17:27:40.519174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 517/1054] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:27:39 2022] POST /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:48.042267 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:48.044505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:48.050887 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:48.051399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:48.051837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:48.052599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:48.053049 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:48.053469 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:48.083339 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8abd83d5-a3df-4a63-a9fd-0584e5b1b6a3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044886 Aug 18 17:27:48.083892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 538/1055] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:27:48 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:48.224834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:48.225416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:48.231575 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:48.232085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:48.232523 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:48.233225 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:48.233705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:48.234131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:48.262085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d5030b05-2ccd-4be4-8075-928c2dedad33 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/f4dcac88-7fa2-4092-87cc-2347a59de6fa" status: 200 len: 194 microversion: 2.1 time: 0.042738 Aug 18 17:27:48.262652 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 518/1056] 10.222.0.82 () {58 vars in 1413 bytes} [Thu Aug 18 17:27:48 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/f4dcac88-7fa2-4092-87cc-2347a59de6fa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:48.273463 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:48.273963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:48.279980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:48.280462 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:48.280914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:48.281590 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:48.282043 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:48.282467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:48.363642 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lazy-loading 'services' on Instance uuid f743d974-14ac-4415-a8e4-b18a8b6fce19 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:27:48.587819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0e3347ea-61e2-4cb5-99e5-9133993d2719 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/f4dcac88-7fa2-4092-87cc-2347a59de6fa" status: 202 len: 0 microversion: 2.1 time: 0.318785 Aug 18 17:27:48.588451 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 539/1057] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:27:48 2022] DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/f4dcac88-7fa2-4092-87cc-2347a59de6fa => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:27:50.760335 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:50.760870 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:50.767347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:50.767831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:50.768266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:50.768965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:50.770026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:50.770649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:50.803908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c13ea479-fe08-4c56-851e-e9e0c59931eb tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/6f710ccb-4de5-41a5-b264-a2a87b7392f7" status: 200 len: 194 microversion: 2.1 time: 0.047438 Aug 18 17:27:50.804488 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 519/1058] 10.222.0.82 () {58 vars in 1413 bytes} [Thu Aug 18 17:27:50 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/6f710ccb-4de5-41a5-b264-a2a87b7392f7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:50.816803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:50.817389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:50.823497 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:50.823982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:50.824428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:50.825122 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:50.825577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:50.826000 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:50.905163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lazy-loading 'services' on Instance uuid f743d974-14ac-4415-a8e4-b18a8b6fce19 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:27:51.118607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-57c3d0ef-f371-4de6-aab6-180de50032da tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/6f710ccb-4de5-41a5-b264-a2a87b7392f7" status: 202 len: 0 microversion: 2.1 time: 0.307030 Aug 18 17:27:51.119240 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 540/1059] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:27:50 2022] DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments/6f710ccb-4de5-41a5-b264-a2a87b7392f7 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:27:52.286411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:52.288986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:52.295306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.295788 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.296213 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.296896 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.297345 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.297764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.327549 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d99ea1af-7d6a-4dd9-ac51-e40caaad1d11 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044991 Aug 18 17:27:52.328026 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 520/1060] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:27:52 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:27:52.443879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:52.446198 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:52.452306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.452783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.453220 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.453912 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.454365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.454786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.483492 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3137aa89-bf48-4197-a00e-f4f34d199741 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044486 Aug 18 17:27:52.484026 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 541/1061] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:27:52 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:27:52.543940 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:52.544437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:52.550198 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.550675 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.551143 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.551827 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.552275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.552694 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.576711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:27:52.845185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5ca8a42b-5317-48b3-b991-31460417cf07 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 204 len: 0 microversion: 2.1 time: 0.304729 Aug 18 17:27:52.845775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 521/1062] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:27:52 2022] DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:27:52.854445 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:52.855628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:52.860957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.861434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.861870 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.862558 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:52.863152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:52.863580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:52.991223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:27:52.998812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e5a61587-2f6b-4805-9201-4a8cfad4b21c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1675 microversion: 2.1 time: 0.148208 Aug 18 17:27:52.999400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 542/1063] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:27:52 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:27:54.026239 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:54.026849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:54.033186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:54.033662 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:54.034091 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:54.034808 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:54.035278 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:54.035699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:54.170231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:27:54.178633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2c39dd00-46e1-439b-94ac-17ce48011a4a tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1675 microversion: 2.1 time: 0.156520 Aug 18 17:27:54.179329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 522/1064] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:27:54 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:27:55.200232 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:55.200898 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:55.207294 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:55.207781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:55.208214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:55.209506 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:55.210142 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:55.210568 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:55.417227 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:27:55.424982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-cd744ad9-c6d2-4791-992b-78998b60d40c tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1675 microversion: 2.1 time: 0.228736 Aug 18 17:27:55.425824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 543/1065] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:27:55 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:27:56.093037 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-c868d5fb-967a-4767-a1a8-5a8b75c84597 req-2c721b68-6fb6-4f79-8ac6-d07300714121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f743d974-14ac-4415-a8e4-b18a8b6fce19", "name": "network-vif-deleted", "tag": "7f1d0cf1-d3f0-4693-b241-55d0e47a09d8"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:27:56.103946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c868d5fb-967a-4767-a1a8-5a8b75c84597 req-2c721b68-6fb6-4f79-8ac6-d07300714121 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:56.107358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c868d5fb-967a-4767-a1a8-5a8b75c84597 req-2c721b68-6fb6-4f79-8ac6-d07300714121 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:56.107358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c868d5fb-967a-4767-a1a8-5a8b75c84597 req-2c721b68-6fb6-4f79-8ac6-d07300714121 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:56.116962 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-c868d5fb-967a-4767-a1a8-5a8b75c84597 req-2c721b68-6fb6-4f79-8ac6-d07300714121 service nova] Creating event network-vif-deleted:7f1d0cf1-d3f0-4693-b241-55d0e47a09d8 for instance f743d974-14ac-4415-a8e4-b18a8b6fce19 on hv-cinder-85367 Aug 18 17:27:56.122052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-c868d5fb-967a-4767-a1a8-5a8b75c84597 req-2c721b68-6fb6-4f79-8ac6-d07300714121 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032773 Aug 18 17:27:56.123064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 523/1066] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:56.448461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:56.449030 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:56.455628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:56.456114 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:56.456550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:56.457249 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:56.457707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:56.458132 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:56.490398 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:56.490933 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:56.491368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:56.491821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lazy-loading 'fault' on Instance uuid f743d974-14ac-4415-a8e4-b18a8b6fce19 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:27:56.533549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5796bbaaf1345b6867d3cd5082f75b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b531205569ec466f8e1ce8ce05427663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:27:56.541940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-df5a5ffa-cfe7-42ee-a758-e7989177bebc tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 200 len: 1328 microversion: 2.1 time: 0.097635 Aug 18 17:27:56.549957 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 544/1067] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:27:56 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:27:57.564418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:57.565120 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:57.572054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:57.572535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:57.573066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:57.573759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:57.574211 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:57.574637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:57.588372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] HTTP exception thrown: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Request method failure captured: Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 HTTP/1.1 Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nT5RIVg-2_fPrks_NR42en54olELXuTQiUdrxg4nDcyHjLB1XxNR_0wIDuSdEa9I8OirP-alh1lIdyrGMXdSl0XHv1U-P5c8dFdpI79qpXkZSy0wDEb5_85hVi6h-tq5Wnid3942RqgPdl6nT5bsz4YbNPlpdkOKcs-SBAX5NzNJXs Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:27:57.589968 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: c5796bbaaf1345b6867d3cd5082f75b0 Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:27:57.591633 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'f743d974-14ac-4415-a8e4-b18a8b6fce19'} Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:27:57.592580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:27:57.594106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:27:57.595640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Returning 404 to user: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:27:57.595640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3f24499e-26f0-47f1-9322-c6cfb13e695e tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 404 len: 111 microversion: 2.1 time: 0.032157 Aug 18 17:27:57.595640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 524/1068] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:27:57 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:27:57.601109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3a535a14-f5f0-4181-926d-4902328189e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '.version_select at 0x7fd1fb4524c0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:57.726496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3a535a14-f5f0-4181-926d-4902328189e3 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613115737" status: 202 len: 0 microversion: 2.1 time: 0.129324 Aug 18 17:27:57.727100 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 545/1069] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 17:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613115737 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:27:59.634263 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:59.634807 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:59.641155 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:59.641636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:59.642070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:59.642763 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:59.643255 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:59.643683 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:59.666510 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-acc0a943-4e33-40b3-a16f-f2b273b89e47 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/ips" status: 200 len: 148 microversion: 2.1 time: 0.036355 Aug 18 17:27:59.667085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 525/1070] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:27:59 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:27:59.679409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2677db1-c6fb-49ae-a8ab-12aeb265fff6"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:27:59.681698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:59.688408 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:59.688882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:59.689311 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:59.689987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:59.690432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:59.690849 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:59.769382 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Invalid volume: volume a2677db1-c6fb-49ae-a8ab-12aeb265fff6 is already attached to instances: 8dcb74ce-bd3d-4943-9d28-4159511befb7 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: POST /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/os-volume_attachments HTTP/1.1 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 74 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:27:59.771296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {"volumeAttachment": {"volumeId": "a2677db1-c6fb-49ae-a8ab-12aeb265fff6"}} Aug 18 17:27:59.772919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Invalid volume: volume a2677db1-c6fb-49ae-a8ab-12aeb265fff6 is already attached to instances: 8dcb74ce-bd3d-4943-9d28-4159511befb7 Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'server_id': 'ec039f68-067d-4759-bbe9-fa09aadb69e6', 'body': {'volumeAttachment': {'volumeId': 'a2677db1-c6fb-49ae-a8ab-12aeb265fff6'}}} Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2677db1-c6fb-49ae-a8ab-12aeb265fff6 is already attached to instances: 8dcb74ce-bd3d-4943-9d28-4159511befb7 Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:27:59.774157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2677db1-c6fb-49ae-a8ab-12aeb265fff6 is already attached to instances: 8dcb74ce-bd3d-4943-9d28-4159511befb7 Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:27:59.775632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2677db1-c6fb-49ae-a8ab-12aeb265fff6 is already attached to instances: 8dcb74ce-bd3d-4943-9d28-4159511befb7 Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 400 to user: Invalid volume: volume a2677db1-c6fb-49ae-a8ab-12aeb265fff6 is already attached to instances: 8dcb74ce-bd3d-4943-9d28-4159511befb7 {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9660f6a9-a61b-4b6f-b7c4-60c0748d6241 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098725 Aug 18 17:27:59.777196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 546/1071] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:27:59 2022] POST /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:27:59.781504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:27:59.782004 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:27:59.788722 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:59.789525 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:59.789682 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:59.790393 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:27:59.790867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:27:59.791306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:27:59.816709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:28:00.113649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-77ef81e6-c120-4736-ae1e-3185457d321f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 204 len: 0 microversion: 2.1 time: 0.335710 Aug 18 17:28:00.114230 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 526/1072] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:27:59 2022] DELETE /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:28:00.122733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:00.123416 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:00.126161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:00.133269 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:00.133788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:00.134222 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:00.134946 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:00.135403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:00.135858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:00.138416 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:00.266266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:00.274360 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-377fc477-4d89-45b2-a279-6d48bf96103d tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1679 microversion: 2.1 time: 0.155695 Aug 18 17:28:00.279442 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 547/1073] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:00 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:01.013168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:01.013762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:01.020276 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:01.021314 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:01.021774 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:01.022485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:01.023043 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:01.023481 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:01.037257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] HTTP exception thrown: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Request method failure captured: Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 HTTP/1.1 Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nT5RIVg-2_fPrks_NR42en54olELXuTQiUdrxg4nDcyHjLB1XxNR_0wIDuSdEa9I8OirP-alh1lIdyrGMXdSl0XHv1U-P5c8dFdpI79qpXkZSy0wDEb5_85hVi6h-tq5Wnid3942RqgPdl6nT5bsz4YbNPlpdkOKcs-SBAX5NzNJXs Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:28:01.038938 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: c5796bbaaf1345b6867d3cd5082f75b0 Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.040443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'f743d974-14ac-4415-a8e4-b18a8b6fce19'} Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:28:01.041372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.042795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.044552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Returning 404 to user: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:28:01.044552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d7182768-707d-4fc4-8060-19e88129bfe0 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 404 len: 111 microversion: 2.1 time: 0.031349 Aug 18 17:28:01.044552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 527/1074] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:28:01 2022] DELETE /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:28:01.048628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:01.049244 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f743d974-14ac-4415-a8e4-b18a8b6fce19] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:01.056936 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:01.057426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:01.057866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:01.058560 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:01.059048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:01.059479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:01.073136 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] HTTP exception thrown: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Request method failure captured: Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 HTTP/1.1 Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nT5RIVg-2_fPrks_NR42en54olELXuTQiUdrxg4nDcyHjLB1XxNR_0wIDuSdEa9I8OirP-alh1lIdyrGMXdSl0XHv1U-P5c8dFdpI79qpXkZSy0wDEb5_85hVi6h-tq5Wnid3942RqgPdl6nT5bsz4YbNPlpdkOKcs-SBAX5NzNJXs Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:28:01.074674 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: c5796bbaaf1345b6867d3cd5082f75b0 Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.076384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'f743d974-14ac-4415-a8e4-b18a8b6fce19'} Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:28:01.077213 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. Aug 18 17:28:01.078707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:01.080143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Returning 404 to user: Instance f743d974-14ac-4415-a8e4-b18a8b6fce19 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:28:01.080143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a8e9cdd7-2915-48c0-82a0-b8fc88e9fa04 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19" status: 404 len: 111 microversion: 2.1 time: 0.031336 Aug 18 17:28:01.080143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 548/1075] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:01 2022] GET /compute/v2.1/servers/f743d974-14ac-4415-a8e4-b18a8b6fce19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:28:01.296959 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:01.297570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:01.303673 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:01.304152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:01.304583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:01.305381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:01.305836 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:01.306268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:01.456231 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:01.464738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-6af287b8-ac24-41f1-9eae-b46c2996764e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1679 microversion: 2.1 time: 0.171776 Aug 18 17:28:01.465290 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 528/1076] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:01 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:02.411597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:02.412742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:02.419840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.420321 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.420808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.421503 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.421953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.422376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.436750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] HTTP exception thrown: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Request method failure captured: Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 HTTP/1.1 Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nT5RIVg-2_fPrks_NR42en54olELXuTQiUdrxg4nDcyHjLB1XxNR_0wIDuSdEa9I8OirP-alh1lIdyrGMXdSl0XHv1U-P5c8dFdpI79qpXkZSy0wDEb5_85hVi6h-tq5Wnid3942RqgPdl6nT5bsz4YbNPlpdkOKcs-SBAX5NzNJXs Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:28:02.438301 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: c5796bbaaf1345b6867d3cd5082f75b0 Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.439730 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'f25511a4-8386-4e28-af43-fd634d160293'} Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:28:02.440512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.441727 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.442929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Returning 404 to user: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:28:02.442929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-87ba610c-737e-4865-8e0f-22c7530579dd tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 404 len: 111 microversion: 2.1 time: 0.032015 Aug 18 17:28:02.442929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 549/1077] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:28:02 2022] DELETE /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:28:02.449143 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:02.449752 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] [instance: f25511a4-8386-4e28-af43-fd634d160293] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:02.456078 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.456553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.456986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.457681 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.458130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.458754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.473575 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] HTTP exception thrown: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Request method failure captured: Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 HTTP/1.1 Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nT5RIVg-2_fPrks_NR42en54olELXuTQiUdrxg4nDcyHjLB1XxNR_0wIDuSdEa9I8OirP-alh1lIdyrGMXdSl0XHv1U-P5c8dFdpI79qpXkZSy0wDEb5_85hVi6h-tq5Wnid3942RqgPdl6nT5bsz4YbNPlpdkOKcs-SBAX5NzNJXs Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:28:02.475649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/b531205569ec466f8e1ce8ce05427663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: b531205569ec466f8e1ce8ce05427663 Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488514920 Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: c5796bbaaf1345b6867d3cd5082f75b0 Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeTestJSON-488514920-project Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.477025 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'f25511a4-8386-4e28-af43-fd634d160293'} Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:28:02.477787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. Aug 18 17:28:02.479054 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:28:02.480193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] Returning 404 to user: Instance f25511a4-8386-4e28-af43-fd634d160293 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:28:02.480193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bbac7dea-3583-41a1-862a-fa9513725311 tempest-AttachVolumeTestJSON-488514920 tempest-AttachVolumeTestJSON-488514920-project] 10.222.0.82 "GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293" status: 404 len: 111 microversion: 2.1 time: 0.031977 Aug 18 17:28:02.480193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 529/1078] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:02 2022] GET /compute/v2.1/servers/f25511a4-8386-4e28-af43-fd634d160293 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:28:02.487366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:02.488407 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:02.494171 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.494847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.495475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.496331 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.497261 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.497839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.588368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:02.595883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-121c8b07-d070-4bca-9f78-13afbed0e140 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 200 len: 1612 microversion: 2.1 time: 0.112981 Aug 18 17:28:02.602467 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 550/1079] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:02 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 1612 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:02.687919 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-b1d4be4e-da4c-4a7d-8dd8-1f6299d70cf9 req-3ba6cac5-a389-40e6-ba5d-19e6b89d3997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec039f68-067d-4759-bbe9-fa09aadb69e6", "name": "network-vif-deleted", "tag": "c955422f-dc01-4d56-8494-c725a5bb61df"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:02.697806 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-b1d4be4e-da4c-4a7d-8dd8-1f6299d70cf9 req-3ba6cac5-a389-40e6-ba5d-19e6b89d3997 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:02.698568 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-b1d4be4e-da4c-4a7d-8dd8-1f6299d70cf9 req-3ba6cac5-a389-40e6-ba5d-19e6b89d3997 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:02.699174 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-b1d4be4e-da4c-4a7d-8dd8-1f6299d70cf9 req-3ba6cac5-a389-40e6-ba5d-19e6b89d3997 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:02.703533 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:02.734177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-b1d4be4e-da4c-4a7d-8dd8-1f6299d70cf9 req-3ba6cac5-a389-40e6-ba5d-19e6b89d3997 service nova] Creating event network-vif-deleted:c955422f-dc01-4d56-8494-c725a5bb61df for instance ec039f68-067d-4759-bbe9-fa09aadb69e6 on hv-cinder-85367 Aug 18 17:28:02.734177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-b1d4be4e-da4c-4a7d-8dd8-1f6299d70cf9 req-3ba6cac5-a389-40e6-ba5d-19e6b89d3997 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038677 Aug 18 17:28:02.734177 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 530/1080] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:03.618698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:03.619733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:03.627039 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:03.627527 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:03.627956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:03.628662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:03.629556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:03.629984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:03.651241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 HTTP/1.1 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:28:03.652960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:28:03.654377 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'ec039f68-067d-4759-bbe9-fa09aadb69e6'} Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:28:03.655242 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:28:03.656439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:03.657531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:28:03.657531 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d9c23678-499d-4848-88df-5e9d36f9bccd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 404 len: 111 microversion: 2.1 time: 0.040771 Aug 18 17:28:03.658655 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 551/1081] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:03 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:28:03.664540 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e63d82f4-68b6-4b51-bc7b-3409db277758 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '.version_select at 0x7fd1f2d913a0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:03.783388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e63d82f4-68b6-4b51-bc7b-3409db277758 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004870675" status: 202 len: 0 microversion: 2.1 time: 0.123453 Aug 18 17:28:03.784307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 531/1082] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 17:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004870675 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:28:04.653673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:04.654215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:04.660428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:04.660900 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:04.661329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:04.662119 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:04.662965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:04.663440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:04.752974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lazy-loading 'services' on Instance uuid 8dcb74ce-bd3d-4943-9d28-4159511befb7 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:28:04.947892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a71dd24a-9eb8-4e10-a285-328585b70505 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments/a2677db1-c6fb-49ae-a8ab-12aeb265fff6" status: 202 len: 0 microversion: 2.1 time: 0.297971 Aug 18 17:28:04.948479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 552/1083] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:28:04 2022] DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments/a2677db1-c6fb-49ae-a8ab-12aeb265fff6 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:28:04.957203 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:04.960307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:04.968705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:04.969195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:04.969638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:04.978583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:04.978583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:04.978583 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:05.003727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-417e7441-82f9-44ff-9b76-1e5ec56698b6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050703 Aug 18 17:28:05.004270 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 532/1084] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:28:04 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:06.017519 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:06.020091 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:06.027366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:06.027965 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:06.028468 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:06.029403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:06.029929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:06.030566 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:06.061437 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9b556601-209a-4c46-8b47-8eb57a493c3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048810 Aug 18 17:28:06.067567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 553/1085] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:28:06 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:28:06.130839 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:06.132037 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:06.144426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:06.144426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:06.144426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:06.144426 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:06.144848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:06.144848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:06.174747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:28:06.507908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4edaed5f-260e-4968-bc0b-f283c76d4766 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 204 len: 0 microversion: 2.1 time: 0.380933 Aug 18 17:28:06.509681 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 533/1086] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:28:06 2022] DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:28:06.517811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:06.518436 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:06.524628 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:06.525106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:06.525538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:06.526262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:06.526717 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:06.527174 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:06.660898 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:06.670126 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-eee18d59-a0c7-465f-90f1-87b435dc33d9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1678 microversion: 2.1 time: 0.156039 Aug 18 17:28:06.670695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 554/1087] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:06 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:07.692380 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:07.693751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:07.700892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:07.701479 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:07.707121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:07.707121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:07.707121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:07.707121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:07.837581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:07.845805 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-430b14f6-7646-49a5-8f8c-98da9a5cb11f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1678 microversion: 2.1 time: 0.157923 Aug 18 17:28:07.853309 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 534/1088] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:07 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:08.872420 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:08.873014 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:08.881627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:08.881627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:08.881866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:08.882598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:08.882986 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:08.883600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:08.988681 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:08.996935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1357f362-deb0-4456-8415-126c347c5d87 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1611 microversion: 2.1 time: 0.128294 Aug 18 17:28:08.997496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 555/1089] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:08 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1611 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:09.074877 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-685bffa8-c0c3-4c39-9b4b-852b637c4738 req-779ebae7-911f-4e82-ac53-cd897e320aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcb74ce-bd3d-4943-9d28-4159511befb7", "name": "network-vif-deleted", "tag": "d99b9889-a89e-4be4-a2ab-7dfb4d184542"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:09.085192 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-685bffa8-c0c3-4c39-9b4b-852b637c4738 req-779ebae7-911f-4e82-ac53-cd897e320aad service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:09.085667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-685bffa8-c0c3-4c39-9b4b-852b637c4738 req-779ebae7-911f-4e82-ac53-cd897e320aad service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:09.086144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-685bffa8-c0c3-4c39-9b4b-852b637c4738 req-779ebae7-911f-4e82-ac53-cd897e320aad service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:09.098080 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-685bffa8-c0c3-4c39-9b4b-852b637c4738 req-779ebae7-911f-4e82-ac53-cd897e320aad service nova] Creating event network-vif-deleted:d99b9889-a89e-4be4-a2ab-7dfb4d184542 for instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 on hv-cinder-85367 Aug 18 17:28:09.103821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-685bffa8-c0c3-4c39-9b4b-852b637c4738 req-779ebae7-911f-4e82-ac53-cd897e320aad service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 Aug 18 17:28:09.105112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 535/1090] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:09.875180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8dcadb99-3909-4ac6-b7ae-a7b034fbfcc7 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1fb5253a0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:09.935159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8dcadb99-3909-4ac6-b7ae-a7b034fbfcc7 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/bc7fe92d-410d-4cbf-aee5-c749c9dc63af" status: 200 len: 351 microversion: 2.1 time: 0.063483 Aug 18 17:28:09.942725 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 556/1091] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:28:09 2022] GET /compute/v2.1/os-volumes/bc7fe92d-410d-4cbf-aee5-c749c9dc63af => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:10.028028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:10.028028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:10.028028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:10.030846 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:10.031637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:10.032143 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:10.032913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:10.033438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:10.033860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:10.075847 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:10.077045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:10.077646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:10.078100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lazy-loading 'fault' on Instance uuid 8dcb74ce-bd3d-4943-9d28-4159511befb7 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:28:10.123075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:10.130258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-30f4c6fe-2164-46c4-9005-b670c15f66b7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 200 len: 1329 microversion: 2.1 time: 0.113958 Aug 18 17:28:10.131442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 536/1092] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:10 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 1329 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:11.152476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:11.153092 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:11.160007 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:11.160488 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:11.160927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:11.161624 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:11.162079 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:11.162595 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:11.175622 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 HTTP/1.1 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:28:11.177305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:28:11.179074 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '8dcb74ce-bd3d-4943-9d28-4159511befb7'} Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:28:11.180089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:28:11.181604 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:28:11.182982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:28:11.182982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7cabc809-830d-447f-8145-7d6d964ae6e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 404 len: 111 microversion: 2.1 time: 0.030879 Aug 18 17:28:11.182982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 557/1093] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:11 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:28:11.188896 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-aec4de75-5656-4f28-827b-e558cecaf5d5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '.version_select at 0x7fd1f2d87f70>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:11.258815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-aec4de75-5656-4f28-827b-e558cecaf5d5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59093405" status: 202 len: 0 microversion: 2.1 time: 0.074375 Aug 18 17:28:11.259440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 537/1094] 10.222.0.82 () {58 vars in 1215 bytes} [Thu Aug 18 17:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59093405 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:28:11.549109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d7fb1c68-86b6-4c57-8275-6381807dec8b tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1fb4db790>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:11.597264 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d7fb1c68-86b6-4c57-8275-6381807dec8b tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/7f005f6e-490e-4f0c-aff4-673619ef4a90" status: 200 len: 351 microversion: 2.1 time: 0.051861 Aug 18 17:28:11.597830 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 558/1095] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:28:11 2022] GET /compute/v2.1/os-volumes/7f005f6e-490e-4f0c-aff4-673619ef4a90 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:12.002291 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1d5f4e6a-ab36-4fc0-9948-2c4df0d5618f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: .version_select at 0x7fd1f2b40b80>, body: {"keypair": {"name": "tempest-keypair-248040900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8gPyxUnwqpGInJzjZP99E5yupE9V/jM7iqXmlh881e+3T6ym4h0TnXYx4JRKMKlg5ErkRT6ItEVPKrETGyuuz+VIUZmnyrEpTNCe9bPT776li6M83ccirc3/sJnMoUVQ=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:12.018083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-1d5f4e6a-ab36-4fc0-9948-2c4df0d5618f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:28:12.022717 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-1d5f4e6a-ab36-4fc0-9948-2c4df0d5618f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:28:12.132172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1d5f4e6a-ab36-4fc0-9948-2c4df0d5618f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134297 Aug 18 17:28:12.132797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 538/1096] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:28:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:28:13.229016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5a292acf-ae76-4076-9efa-65c5c5b454b8 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1fb4524c0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.277399 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5a292acf-ae76-4076-9efa-65c5c5b454b8 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/332b3870-ab5c-47a9-9182-ed4bef74820e" status: 200 len: 350 microversion: 2.1 time: 0.052788 Aug 18 17:28:13.278176 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 559/1097] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes/332b3870-ab5c-47a9-9182-ed4bef74820e => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:13.290798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-5ce517c2-3cef-4811-b4f7-3b2437bd4077 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1f2d91310>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.374027 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-5ce517c2-3cef-4811-b4f7-3b2437bd4077 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087518 Aug 18 17:28:13.374682 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 539/1098] 10.222.0.82 () {58 vars in 1134 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:13.388559 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-88067c69-5e50-4eaa-96f4-7fa1149ecc25 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1fb5479d0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.471779 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-88067c69-5e50-4eaa-96f4-7fa1149ecc25 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086827 Aug 18 17:28:13.472437 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 560/1099] 10.222.0.82 () {58 vars in 1149 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:28:13.485955 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4372fe45-00ac-444d-b282-69c7047f9c33 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1f2d87ee0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.568764 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4372fe45-00ac-444d-b282-69c7047f9c33 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085843 Aug 18 17:28:13.569515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 540/1100] 10.222.0.82 () {58 vars in 1134 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:13.581835 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d73ee9f2-2aaa-4beb-a968-4560d631db68 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1fb4db040>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.666183 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d73ee9f2-2aaa-4beb-a968-4560d631db68 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087936 Aug 18 17:28:13.666749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 561/1101] 10.222.0.82 () {58 vars in 1167 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:13.680888 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-50d9fb44-0d50-430b-a956-bcb13f28a771 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1f2d40af0>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.764770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-50d9fb44-0d50-430b-a956-bcb13f28a771 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088595 Aug 18 17:28:13.765440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 541/1102] 10.222.0.82 () {58 vars in 1170 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:13.778427 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4aad3b1b-0d3a-46fd-b1c6-3b9710504337 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1fb597d30>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.862789 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4aad3b1b-0d3a-46fd-b1c6-3b9710504337 tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088059 Aug 18 17:28:13.863444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 562/1103] 10.222.0.82 () {58 vars in 1155 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:13.876693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-eb14949b-b418-44d3-8bed-183aa4abf67b tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1f2d87550>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:13.962361 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-eb14949b-b418-44d3-8bed-183aa4abf67b tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089423 Aug 18 17:28:13.962969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 542/1104] 10.222.0.82 () {58 vars in 1188 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:13.976589 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-292ddd83-5be2-4b2f-975d-b3989e93832e tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] Calling method '.version_select at 0x7fd1f8a80af0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:14.062097 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-292ddd83-5be2-4b2f-975d-b3989e93832e tempest-VolumesTestJSON-483386341 tempest-VolumesTestJSON-483386341-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089938 Aug 18 17:28:14.062842 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 563/1105] 10.222.0.82 () {58 vars in 1155 bytes} [Thu Aug 18 17:28:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:14.339699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-504875774", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3c0c0db-a3aa-43d0-b2aa-cb12907841f7"}], "security_groups": [{"name": "tempest-securitygroup--932212317"}], "key_name": "tempest-keypair-248040900", "user_data": "}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:14.443753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.network.neutron [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] validate_networks() for [('b3c0c0db-a3aa-43d0-b2aa-cb12907841f7', None, None, None, None, None)] {{(pid=121217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:28:15.052598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:28:15.053064 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image limits 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:28:15.053603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:28:15.054011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image pref 0:0:0 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:28:15.054418 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.virt.hardware [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:28:15.063268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:15.063742 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:15.064171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:15.064894 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:15.065340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:15.065762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:15.085365 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:28:15.089302 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:28:15.100388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Going to run 1 instances... {{(pid=121217) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:28:15.102659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:28:15.234845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-10543b5c-77b0-4ff1-890d-b2b60d7f74e5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.901362 Aug 18 17:28:15.235566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 543/1106] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:28:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:28:15.247487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f326349d-4bed-46b1-a800-2a7de6234823 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:15.248188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-f326349d-4bed-46b1-a800-2a7de6234823 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:15.301422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-f326349d-4bed-46b1-a800-2a7de6234823 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:15.308757 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f326349d-4bed-46b1-a800-2a7de6234823 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1240 microversion: 2.1 time: 0.065672 Aug 18 17:28:15.309564 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 564/1107] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:15 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:16.330946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:16.331591 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:16.338347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:16.338840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:16.339545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:16.340251 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:16.340741 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:16.341167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:16.406288 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:16.416045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e7a7dd01-7c37-4539-9d28-c89f9c93858f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1244 microversion: 2.1 time: 0.089710 Aug 18 17:28:16.416612 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 544/1108] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:16 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:17.437572 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:17.438178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:17.446133 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:17.446607 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:17.447061 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:17.447747 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:17.448192 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:17.448608 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:17.534687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:17.542669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-fa56f71e-d8bc-4acb-a966-c9e3a68acce2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1298 microversion: 2.1 time: 0.109192 Aug 18 17:28:17.543263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 565/1109] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:17 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:18.564743 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:18.565411 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:18.571684 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:18.574133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:18.574133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:18.574133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:18.574133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:18.574605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:18.802351 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:18.811045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f1e2f85f-d0b1-44c6-894a-16084bf99afd tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.251044 Aug 18 17:28:18.811710 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 545/1110] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:18 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:18.998292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-8acbd5a7-1b81-49fa-bcab-3415b1dd0e4b req-d576171d-70b1-40d1-bf94-de5f5bdf6f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36377547-972d-4cfa-b9db-abc82887b87d", "tag": "35792096-4559-4c9e-bd33-439ca5b83869"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:19.008103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-8acbd5a7-1b81-49fa-bcab-3415b1dd0e4b req-d576171d-70b1-40d1-bf94-de5f5bdf6f83 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:19.018840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-8acbd5a7-1b81-49fa-bcab-3415b1dd0e4b req-d576171d-70b1-40d1-bf94-de5f5bdf6f83 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:19.018840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-8acbd5a7-1b81-49fa-bcab-3415b1dd0e4b req-d576171d-70b1-40d1-bf94-de5f5bdf6f83 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:19.020138 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-8acbd5a7-1b81-49fa-bcab-3415b1dd0e4b req-d576171d-70b1-40d1-bf94-de5f5bdf6f83 service nova] Creating event network-changed:35792096-4559-4c9e-bd33-439ca5b83869 for instance 36377547-972d-4cfa-b9db-abc82887b87d on hv-cinder-85367 Aug 18 17:28:19.026455 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-8acbd5a7-1b81-49fa-bcab-3415b1dd0e4b req-d576171d-70b1-40d1-bf94-de5f5bdf6f83 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032000 Aug 18 17:28:19.027371 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 566/1111] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:28:19.832199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:19.832830 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:19.839745 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:19.840223 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:19.840650 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:19.841462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:19.841911 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:19.842330 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:19.972667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:19.980768 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-90d903b9-6285-4e45-b43f-c287e7274f6e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.152614 Aug 18 17:28:19.981358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 546/1112] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:19 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:28:21.002088 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:21.003011 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:21.010270 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:21.010750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:21.011211 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:21.011902 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:21.012481 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:21.012969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:21.158557 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:21.166300 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dfc59d33-7694-40f7-9e16-c6a7cf109559 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.168437 Aug 18 17:28:21.166863 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 567/1113] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:20 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:22.187005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:22.187622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:22.195493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:22.196099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:22.196640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:22.197448 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:22.198005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:22.198537 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:22.374181 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:22.389352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1f940649-b511-4e91-beea-0e2a42204583 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.199894 Aug 18 17:28:22.389352 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 547/1114] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:22 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:23.403393 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:23.403875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:23.409780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:23.410259 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:23.410684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:23.411998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:23.412454 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:23.412902 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:23.550994 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:23.559853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0d79ea3f-9430-45fc-a64d-caeb236115b5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.160501 Aug 18 17:28:23.560548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 568/1115] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:23 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:24.581529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:24.582136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:24.589468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:24.589952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:24.590391 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:24.591122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:24.591579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:24.592006 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:24.724662 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:24.732527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-585bb6e4-bfd0-427e-b9b7-84b2f6707e15 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.154852 Aug 18 17:28:24.733101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 548/1116] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:24 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:25.353751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-d8652c83-168f-41dc-9e86-9f9b780fc6e9 req-4a6a4014-9b66-4db9-aa43-d324cac0f119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36377547-972d-4cfa-b9db-abc82887b87d", "name": "network-vif-plugged", "status": "completed", "tag": "35792096-4559-4c9e-bd33-439ca5b83869"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:25.360330 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:25.364513 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-d8652c83-168f-41dc-9e86-9f9b780fc6e9 req-4a6a4014-9b66-4db9-aa43-d324cac0f119 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:25.365008 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-d8652c83-168f-41dc-9e86-9f9b780fc6e9 req-4a6a4014-9b66-4db9-aa43-d324cac0f119 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:25.365438 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-d8652c83-168f-41dc-9e86-9f9b780fc6e9 req-4a6a4014-9b66-4db9-aa43-d324cac0f119 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:25.379155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-d8652c83-168f-41dc-9e86-9f9b780fc6e9 req-4a6a4014-9b66-4db9-aa43-d324cac0f119 service nova] Creating event network-vif-plugged:35792096-4559-4c9e-bd33-439ca5b83869 for instance 36377547-972d-4cfa-b9db-abc82887b87d on hv-cinder-85367 Aug 18 17:28:25.385306 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-d8652c83-168f-41dc-9e86-9f9b780fc6e9 req-4a6a4014-9b66-4db9-aa43-d324cac0f119 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035232 Aug 18 17:28:25.385897 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 569/1117] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:28:25.753580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:25.754195 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:25.756862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:25.757522 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=10 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:28:25.762720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:25.763235 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:25.763673 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:25.764372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:25.764823 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:25.765244 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:25.907623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:25.916079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c92a2dae-b2d2-4ad2-bdd5-76f40d0a356e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.166280 Aug 18 17:28:25.916849 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 549/1118] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:25 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:26.938376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:26.939103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:26.946059 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:26.946545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:26.947016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:26.947711 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:26.948162 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:26.948584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:27.085752 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:27.093449 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b76a6315-1957-4bff-bfe9-a4ab03722514 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1365 microversion: 2.1 time: 0.159485 Aug 18 17:28:27.094057 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 570/1119] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:26 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:28.115843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:28.116467 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:28.122995 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:28.123475 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:28.123910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:28.124601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:28.125051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:28.125471 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:28.262661 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:28:28.270733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d09e3b60-1184-403e-8e50-dd3f46f3b5c7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1554 microversion: 2.1 time: 0.158995 Aug 18 17:28:28.271358 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 550/1120] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:28:28 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:28:28.292024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:28:28.297716 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:28:28.299025 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:28.299502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:28.299937 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:28.300626 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:28.301073 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:28.301496 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:28.381034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-eeb69878-b2ba-4198-a8d1-3eb26e1e5ee0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092800 Aug 18 17:28:28.381617 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 571/1121] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:28:28 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:28:29.624709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-ef0f8e6e-ae0c-4fb0-a2ea-8b4579012660 req-210c4200-a99f-48a4-aba1-42f5adfa9be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36377547-972d-4cfa-b9db-abc82887b87d", "tag": "35792096-4559-4c9e-bd33-439ca5b83869"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:28:29.634953 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ef0f8e6e-ae0c-4fb0-a2ea-8b4579012660 req-210c4200-a99f-48a4-aba1-42f5adfa9be2 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:28:29.635431 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ef0f8e6e-ae0c-4fb0-a2ea-8b4579012660 req-210c4200-a99f-48a4-aba1-42f5adfa9be2 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:28:29.635862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ef0f8e6e-ae0c-4fb0-a2ea-8b4579012660 req-210c4200-a99f-48a4-aba1-42f5adfa9be2 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:28:29.646650 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-ef0f8e6e-ae0c-4fb0-a2ea-8b4579012660 req-210c4200-a99f-48a4-aba1-42f5adfa9be2 service nova] Creating event network-changed:35792096-4559-4c9e-bd33-439ca5b83869 for instance 36377547-972d-4cfa-b9db-abc82887b87d on hv-cinder-85367 Aug 18 17:28:29.651709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-ef0f8e6e-ae0c-4fb0-a2ea-8b4579012660 req-210c4200-a99f-48a4-aba1-42f5adfa9be2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030897 Aug 18 17:28:29.652655 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 551/1122] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:29:15.522571 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:29:15.523165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Thu Aug 18 17:29:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:29:24.476762 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=37 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:24.477525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:24.481450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1709901854", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:29:24.534033 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] validate_networks() for None {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:29:24.804516 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:29:24.804947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:29:24.805428 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:29:24.805839 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:29:24.806253 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:29:24.815298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:24.815788 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:24.816223 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:24.816953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:24.817410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:24.817837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:24.834606 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Getting quotas for project 596a9a6708ff4cffb91ebb767bc1de6c. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:29:24.838535 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Getting quotas for user 4cc76ea92fcb4686a87006880fef657c and project 596a9a6708ff4cffb91ebb767bc1de6c. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:29:24.849969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:29:24.852271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:29:24.993011 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a6e707b0-8889-44e3-a648-49d60eb7f4dd tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517646 Aug 18 17:29:24.993648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 572/1123] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:29:25.003396 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:25.004199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:25.008280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-52b47e74-8642-4b6a-a47b-38dba6a8ea81 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:25.008992 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-52b47e74-8642-4b6a-a47b-38dba6a8ea81 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:25.063273 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-52b47e74-8642-4b6a-a47b-38dba6a8ea81 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:25.070082 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-52b47e74-8642-4b6a-a47b-38dba6a8ea81 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1215 microversion: 2.1 time: 0.068662 Aug 18 17:29:25.070642 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 552/1124] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:25 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:29:26.092353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0fcbf385-9c81-4896-a557-d62f18380858 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:26.093098 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0fcbf385-9c81-4896-a557-d62f18380858 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:26.149765 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0fcbf385-9c81-4896-a557-d62f18380858 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:26.156627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0fcbf385-9c81-4896-a557-d62f18380858 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1215 microversion: 2.1 time: 0.068824 Aug 18 17:29:26.157182 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 573/1125] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:26 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:27.177451 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:27.178123 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:27.186621 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:27.187133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:27.187573 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:27.189089 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:27.189626 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:27.190050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:27.276787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:27.284853 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9d02989f-086f-42c0-9a94-97d8694d37cc tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1275 microversion: 2.1 time: 0.111370 Aug 18 17:29:27.285433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 553/1126] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:27 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:28.305583 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:28.306283 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:28.312878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:28.313365 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:28.313803 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:28.314500 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:28.314973 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:28.315398 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:28.552068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:28.559996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9ac547ce-b90a-48e2-a556-293bfd5d3311 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.258303 Aug 18 17:29:28.560551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 574/1127] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:28 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:29.088381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-5da4b21f-8fec-4869-9393-b27b3c4e3e61 req-84626327-9559-46d0-a3c5-328172410fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b2ce9-84fe-427e-b147-89e6c306f946", "tag": "749b69f3-d906-45f0-bbe1-47ab196e8ddd"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:29:29.100824 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-5da4b21f-8fec-4869-9393-b27b3c4e3e61 req-84626327-9559-46d0-a3c5-328172410fa4 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:29.102319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-5da4b21f-8fec-4869-9393-b27b3c4e3e61 req-84626327-9559-46d0-a3c5-328172410fa4 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:29.102319 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-5da4b21f-8fec-4869-9393-b27b3c4e3e61 req-84626327-9559-46d0-a3c5-328172410fa4 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:29.112880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-5da4b21f-8fec-4869-9393-b27b3c4e3e61 req-84626327-9559-46d0-a3c5-328172410fa4 service nova] Creating event network-changed:749b69f3-d906-45f0-bbe1-47ab196e8ddd for instance 638b2ce9-84fe-427e-b147-89e6c306f946 on hv-cinder-85367 Aug 18 17:29:29.117744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-5da4b21f-8fec-4869-9393-b27b3c4e3e61 req-84626327-9559-46d0-a3c5-328172410fa4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033094 Aug 18 17:29:29.118337 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 554/1128] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:29:29.581704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:29.582265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:29.588840 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:29.589327 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:29.589764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:29.590458 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:29.590932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:29.591389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:29.786368 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:29.794137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-df3c27bf-8dae-4de1-8365-d7f428a236da tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.216434 Aug 18 17:29:29.801232 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 575/1129] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:29 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:30.816699 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:30.817390 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:30.823545 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:30.824024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:30.824455 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:30.825142 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:30.825594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:30.826018 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:30.959284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:30.966884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-fed623fc-e797-40b0-8604-c13cfbeb1eb2 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.155237 Aug 18 17:29:30.967472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 555/1130] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:30 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:31.988634 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:31.989188 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:31.995658 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:31.996172 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:31.996568 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:31.997260 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:31.997714 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:31.998137 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:32.125930 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:32.133619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6f5893b0-260a-4588-8bf1-830b8ec7ee46 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.149662 Aug 18 17:29:32.134169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 576/1131] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:31 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:33.155284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:33.155892 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:33.162509 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:33.163011 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:33.163444 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:33.164124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:33.164570 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:33.164989 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:33.290770 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:33.298433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-8f6060f4-052c-4c07-9771-9e173d4a4b7a tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.147201 Aug 18 17:29:33.299021 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 556/1132] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:33 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:34.319405 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:34.320167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:34.326484 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:34.326996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:34.327425 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:34.328112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:34.329106 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:34.329820 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:34.465387 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:34.474002 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8ad5049f-38f7-4815-975d-67110d686c02 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.158430 Aug 18 17:29:34.474551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 577/1133] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:34 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:35.494433 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:35.495066 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:35.497553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:35.502705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:35.503215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:35.503646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:35.504337 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:35.504781 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:35.505200 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:35.649718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:35.663152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:35.670912 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9ae60ea9-24b6-439f-9d66-8c40b314af37 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.180441 Aug 18 17:29:35.671494 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 557/1134] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:35 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:35.772286 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-20be2041-72cf-4bd6-9707-765c70cf9047 req-51e77ec5-b459-4282-8a95-3a643a86e4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b2ce9-84fe-427e-b147-89e6c306f946", "name": "network-vif-plugged", "status": "completed", "tag": "749b69f3-d906-45f0-bbe1-47ab196e8ddd"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:29:35.782687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-20be2041-72cf-4bd6-9707-765c70cf9047 req-51e77ec5-b459-4282-8a95-3a643a86e4c3 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:35.785015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-20be2041-72cf-4bd6-9707-765c70cf9047 req-51e77ec5-b459-4282-8a95-3a643a86e4c3 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:35.785015 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-20be2041-72cf-4bd6-9707-765c70cf9047 req-51e77ec5-b459-4282-8a95-3a643a86e4c3 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:35.794988 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-20be2041-72cf-4bd6-9707-765c70cf9047 req-51e77ec5-b459-4282-8a95-3a643a86e4c3 service nova] Creating event network-vif-plugged:749b69f3-d906-45f0-bbe1-47ab196e8ddd for instance 638b2ce9-84fe-427e-b147-89e6c306f946 on hv-cinder-85367 Aug 18 17:29:35.800512 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-20be2041-72cf-4bd6-9707-765c70cf9047 req-51e77ec5-b459-4282-8a95-3a643a86e4c3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157046 Aug 18 17:29:35.801215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 578/1135] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:29:36.692646 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:36.693241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:36.699595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:36.700070 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:36.700497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:36.701183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:36.701631 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:36.702052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:36.832423 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:36.839910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-83387dfb-40a9-4e60-9ea7-50b59dff6ca3 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1315 microversion: 2.1 time: 0.151157 Aug 18 17:29:36.840501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 558/1136] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:36 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:37.858530 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=8 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:37.863265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:37.864772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:37.870424 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:37.870868 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:37.871335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:37.872021 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:37.872476 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:37.872900 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:38.004544 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:38.012412 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2b81be6e-6913-4823-95bd-5c6421b2f156 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1465 microversion: 2.1 time: 0.154821 Aug 18 17:29:38.012966 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 579/1137] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:37 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:38.056997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:38.057502 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:38.063997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:38.064476 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:38.064909 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:38.065599 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:38.066048 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:38.066468 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:38.091106 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:29:38.367913 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-daa8d842-bfe0-4f57-b035-50f949d91576 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "DELETE /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 204 len: 0 microversion: 2.1 time: 0.314752 Aug 18 17:29:38.368499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 559/1138] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:29:38 2022] DELETE /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:29:38.377597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:38.391385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:38.391385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:38.391385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:38.391385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:38.391780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:38.391780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:38.391780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:38.521990 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:38.529996 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3a88f643-1b0b-4ed8-b669-46c1036bb5d7 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1471 microversion: 2.1 time: 0.157144 Aug 18 17:29:38.530554 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 580/1139] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:38 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:39.552056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:39.552747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:39.559343 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:39.559819 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:39.560249 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:39.560965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:39.561440 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:39.561852 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:39.689929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:39.697554 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-899b594b-7a64-436d-9725-aa89e8a132eb tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1471 microversion: 2.1 time: 0.149924 Aug 18 17:29:39.698158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 560/1140] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:39 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:29:40.535824 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-175f3218-a3bc-4921-b603-90a13bf4d480 req-64e0d21d-f91b-441b-b159-b8e84f14a4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b2ce9-84fe-427e-b147-89e6c306f946", "name": "network-vif-deleted", "tag": "749b69f3-d906-45f0-bbe1-47ab196e8ddd"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:29:40.546543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-175f3218-a3bc-4921-b603-90a13bf4d480 req-64e0d21d-f91b-441b-b159-b8e84f14a4e7 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:40.553124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-175f3218-a3bc-4921-b603-90a13bf4d480 req-64e0d21d-f91b-441b-b159-b8e84f14a4e7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:40.553124 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-175f3218-a3bc-4921-b603-90a13bf4d480 req-64e0d21d-f91b-441b-b159-b8e84f14a4e7 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:40.559821 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-175f3218-a3bc-4921-b603-90a13bf4d480 req-64e0d21d-f91b-441b-b159-b8e84f14a4e7 service nova] Creating event network-vif-deleted:749b69f3-d906-45f0-bbe1-47ab196e8ddd for instance 638b2ce9-84fe-427e-b147-89e6c306f946 on hv-cinder-85367 Aug 18 17:29:40.565152 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-175f3218-a3bc-4921-b603-90a13bf4d480 req-64e0d21d-f91b-441b-b159-b8e84f14a4e7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 Aug 18 17:29:40.565861 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 581/1141] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:29:40.718516 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:40.719280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:40.725738 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:40.726219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:40.726693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:40.727422 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:40.727874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:40.728298 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:40.791836 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc76ea92fcb4686a87006880fef657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596a9a6708ff4cffb91ebb767bc1de6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:29:40.799762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-d47acab6-4e1d-487e-aa7a-3ee632862744 tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 200 len: 1300 microversion: 2.1 time: 0.085129 Aug 18 17:29:40.800331 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 561/1142] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:40 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:29:41.824167 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:41.824853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] [instance: 638b2ce9-84fe-427e-b147-89e6c306f946] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:41.831867 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:41.832339 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:41.832767 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:41.833446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:41.833890 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:41.834319 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:41.848162 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] HTTP exception thrown: Instance 638b2ce9-84fe-427e-b147-89e6c306f946 could not be found. Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Request method failure captured: Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 HTTP/1.1 Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nby3IKZSDfKd3MSWW8Aur5LqymQcAgj-JsGm2IGuGJPxFKQRR5OCtFfKNiZGR25zKej-glOlvuL4YYv3NVgN8rEtyJQszbGAoVJZ6Zw8qMHGHFXbS82GT0pi94aPWfESekcczdVuAZlV8BQzt2EPqWKRRF__w3Uk-swJhpguoyw3OM Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 596a9a6708ff4cffb91ebb767bc1de6c Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-VolumesNegativeTest-1789978343 Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:29:41.849776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/596a9a6708ff4cffb91ebb767bc1de6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_596a9a6708ff4cffb91ebb767bc1de6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/596a9a6708ff4cffb91ebb767bc1de6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/596a9a6708ff4cffb91ebb767bc1de6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-VolumesNegativeTest-1789978343 Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 596a9a6708ff4cffb91ebb767bc1de6c Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-VolumesNegativeTest-1789978343 Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-VolumesNegativeTest-1789978343-project Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: 4cc76ea92fcb4686a87006880fef657c Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-VolumesNegativeTest-1789978343-project Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 638b2ce9-84fe-427e-b147-89e6c306f946 could not be found. Aug 18 17:29:41.851460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '638b2ce9-84fe-427e-b147-89e6c306f946'} Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 638b2ce9-84fe-427e-b147-89e6c306f946 could not be found. Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:29:41.852640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 638b2ce9-84fe-427e-b147-89e6c306f946 could not be found. Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 638b2ce9-84fe-427e-b147-89e6c306f946 could not be found. Aug 18 17:29:41.854160 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:29:41.855670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] Returning 404 to user: Instance 638b2ce9-84fe-427e-b147-89e6c306f946 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:29:41.855670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-87f053c8-c5c5-48ea-88a7-3dec52e70b8e tempest-VolumesNegativeTest-1789978343 tempest-VolumesNegativeTest-1789978343-project] 10.222.0.82 "GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946" status: 404 len: 111 microversion: 2.1 time: 0.031685 Aug 18 17:29:41.855670 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 582/1143] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:29:41 2022] GET /compute/v2.1/servers/638b2ce9-84fe-427e-b147-89e6c306f946 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:29:59.391175 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:59.392110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:29:59.607820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:29:59.608316 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:29:59.615164 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:59.615644 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:59.616133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:59.616818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:29:59.617329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:29:59.617751 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:29:59.639952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c102c149-5902-458d-aece-d7a456918288 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/ips" status: 200 len: 148 microversion: 2.1 time: 0.253806 Aug 18 17:29:59.640534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 562/1144] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:29:59 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/ips => generated 148 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:01.221765 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf406e3f-8eac-4c3d-81f5-d639d5ceb56d"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:01.224817 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:01.227040 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:01.231819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=44 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:01.232289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:01.232761 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:01.233190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:01.233879 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:01.234324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:01.234743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:02.005410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0a435479-a7ee-4268-bedc-90d801b429d4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.787958 Aug 18 17:30:02.005949 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 583/1145] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:30:01 2022] POST /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:09.534969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf406e3f-8eac-4c3d-81f5-d639d5ceb56d"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:09.537400 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:09.543893 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:09.544381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:09.544818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:09.545521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:09.545976 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:09.546403 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:09.624493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Invalid volume: volume bf406e3f-8eac-4c3d-81f5-d639d5ceb56d is already attached to instances: 36377547-972d-4cfa-b9db-abc82887b87d Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: POST /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments HTTP/1.1 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 74 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:30:09.626233 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {"volumeAttachment": {"volumeId": "bf406e3f-8eac-4c3d-81f5-d639d5ceb56d"}} Aug 18 17:30:09.627993 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Invalid volume: volume bf406e3f-8eac-4c3d-81f5-d639d5ceb56d is already attached to instances: 36377547-972d-4cfa-b9db-abc82887b87d Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'server_id': '36377547-972d-4cfa-b9db-abc82887b87d', 'body': {'volumeAttachment': {'volumeId': 'bf406e3f-8eac-4c3d-81f5-d639d5ceb56d'}}} Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf406e3f-8eac-4c3d-81f5-d639d5ceb56d is already attached to instances: 36377547-972d-4cfa-b9db-abc82887b87d Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:09.629128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf406e3f-8eac-4c3d-81f5-d639d5ceb56d is already attached to instances: 36377547-972d-4cfa-b9db-abc82887b87d Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:30:09.630645 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf406e3f-8eac-4c3d-81f5-d639d5ceb56d is already attached to instances: 36377547-972d-4cfa-b9db-abc82887b87d Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 400 to user: Invalid volume: volume bf406e3f-8eac-4c3d-81f5-d639d5ceb56d is already attached to instances: 36377547-972d-4cfa-b9db-abc82887b87d {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-a6bed602-b8fb-4940-a6e4-83a8cb5187ac tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097370 Aug 18 17:30:09.632473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 563/1146] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:30:09 2022] POST /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:30:09.693651 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:09.696047 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:09.700486 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:09.700969 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:09.701410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:09.702102 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:09.702594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:09.703047 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:09.783343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lazy-loading 'services' on Instance uuid 36377547-972d-4cfa-b9db-abc82887b87d {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:30:09.993204 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5a510542-32c1-4a21-ad9e-e97036017c2c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments/bf406e3f-8eac-4c3d-81f5-d639d5ceb56d" status: 202 len: 0 microversion: 2.1 time: 0.304057 Aug 18 17:30:09.993929 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 584/1147] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:30:09 2022] DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments/bf406e3f-8eac-4c3d-81f5-d639d5ceb56d => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:30:10.002546 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:10.004749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:10.011617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:10.012099 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:10.012538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:10.013240 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:10.013700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:10.014129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:10.044109 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c62d3107-d9ec-4c43-b700-056cf48e4fbf tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Aug 18 17:30:10.044665 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 564/1148] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:30:09 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:11.058542 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:11.060855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:11.067143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:11.068008 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:11.068139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:11.068728 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:11.069178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:11.069600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:11.100924 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ebe08930-ce2a-48a2-ad0b-e5e04e37b734 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047577 Aug 18 17:30:11.101446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 585/1149] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:30:11 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:30:11.161726 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:11.162257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:11.168678 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:11.169162 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:11.169605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:11.170293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:11.170744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:11.171190 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:11.199493 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:30:11.492521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-06358ce8-d122-4f49-8b89-a4aade8a6f3a tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 204 len: 0 microversion: 2.1 time: 0.334768 Aug 18 17:30:11.493030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 565/1150] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:30:11 2022] DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:30:11.500984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:11.501620 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:11.507676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:11.510298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:11.510298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:11.510298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:11.510298 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:11.510688 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:11.645277 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:11.653006 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-dbe1a401-7e0f-4a37-ba98-c304c4020133 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1678 microversion: 2.1 time: 0.155796 Aug 18 17:30:11.653569 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 586/1151] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:11 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:12.674821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:12.675762 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:12.682572 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:12.683117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:12.683552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:12.684247 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:12.684698 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:12.685125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:12.819090 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:12.826879 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f21ece6c-da76-49a9-a2d4-55742c9d7182 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1678 microversion: 2.1 time: 0.156920 Aug 18 17:30:12.827473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 566/1152] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:12 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:13.849978 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:13.850595 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:13.857099 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:13.857576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:13.858008 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:13.858692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:13.859166 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:13.859588 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:13.947751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:13.958420 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3140ccd5-005e-45d0-9026-520acc89c4a5 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1611 microversion: 2.1 time: 0.113220 Aug 18 17:30:13.959164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 587/1153] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:13 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1611 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:14.173035 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-5d0ab3be-9129-4c90-b87c-6b3613d78f83 req-6fa2d855-fe30-4512-9229-efc37249827b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36377547-972d-4cfa-b9db-abc82887b87d", "name": "network-vif-deleted", "tag": "35792096-4559-4c9e-bd33-439ca5b83869"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:14.183981 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-5d0ab3be-9129-4c90-b87c-6b3613d78f83 req-6fa2d855-fe30-4512-9229-efc37249827b service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:14.184460 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-5d0ab3be-9129-4c90-b87c-6b3613d78f83 req-6fa2d855-fe30-4512-9229-efc37249827b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:14.184890 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-5d0ab3be-9129-4c90-b87c-6b3613d78f83 req-6fa2d855-fe30-4512-9229-efc37249827b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:14.198944 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-5d0ab3be-9129-4c90-b87c-6b3613d78f83 req-6fa2d855-fe30-4512-9229-efc37249827b service nova] Creating event network-vif-deleted:35792096-4559-4c9e-bd33-439ca5b83869 for instance 36377547-972d-4cfa-b9db-abc82887b87d on hv-cinder-85367 Aug 18 17:30:14.205457 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-5d0ab3be-9129-4c90-b87c-6b3613d78f83 req-6fa2d855-fe30-4512-9229-efc37249827b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Aug 18 17:30:14.206241 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 567/1154] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:14.980196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:14.980907 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:14.988019 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:14.988510 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:14.988947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:14.989753 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:14.990087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:14.990524 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:15.025469 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:15.026104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:15.026493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:15.026954 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lazy-loading 'fault' on Instance uuid 36377547-972d-4cfa-b9db-abc82887b87d {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:30:15.071474 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:15.079676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6a95564f-3c6a-482f-8252-3931eb090df9 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 200 len: 1330 microversion: 2.1 time: 0.102848 Aug 18 17:30:15.080875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 588/1155] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:14 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:16.102146 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:16.102844 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:16.108948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:16.109425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:16.109861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:16.110552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:16.111709 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:16.112439 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:16.125635 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d HTTP/1.1 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:30:16.128112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:30:16.129729 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '36377547-972d-4cfa-b9db-abc82887b87d'} Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:30:16.131559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:30:16.132929 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:30:16.134306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:30:16.134306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7945e4f8-7c33-4243-80fc-06e7147683d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 404 len: 111 microversion: 2.1 time: 0.032048 Aug 18 17:30:16.134306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 568/1156] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:16 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:30:16.139148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-f35edc64-2911-4495-bacf-ee1fbaa1a4a7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '.version_select at 0x7fd1fb4db1f0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:16.218826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-f35edc64-2911-4495-bacf-ee1fbaa1a4a7 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248040900" status: 202 len: 0 microversion: 2.1 time: 0.083457 Aug 18 17:30:16.219439 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 589/1157] 10.222.0.82 () {58 vars in 1218 bytes} [Thu Aug 18 17:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248040900 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:30:17.001258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0e774b75-55cf-447e-870d-ab29b12e0356 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: .version_select at 0x7fd1f2d824c0>, body: {"keypair": {"name": "tempest-keypair-1991756767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZGD9e4b3FpmPhqDGyLbB+tWjLlNI6A7l2jZ1BmEj2YZJI624B8VohqdRqCt88Zpe3icSvQIUnSOkJ5hF1PNFUbDRvmngXEtX/sSowmeAvfaHb1v920Ub6zkiRVkzulA=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:17.016653 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-0e774b75-55cf-447e-870d-ab29b12e0356 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:30:17.020628 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-0e774b75-55cf-447e-870d-ab29b12e0356 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:30:17.115690 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0e774b75-55cf-447e-870d-ab29b12e0356 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118239 Aug 18 17:30:17.116443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 569/1158] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:30:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:19.303975 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-130795009", "imageRef": "89406606-0f19-4f57-b05b-02d04ed8b39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3c0c0db-a3aa-43d0-b2aa-cb12907841f7"}], "security_groups": [{"name": "tempest-securitygroup--1346293340"}], "key_name": "tempest-keypair-1991756767", "user_data": "}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:19.407434 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] validate_networks() for [('b3c0c0db-a3aa-43d0-b2aa-cb12907841f7', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:30:19.774940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:30:19.782884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:30:19.782884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:30:19.782884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:30:19.782884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:30:19.786054 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:19.786529 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:19.786981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:19.787733 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:19.788178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:19.788594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:19.806083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:30:19.810103 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Getting quotas for user da44ae3a4e8b41d3b8a3193db939e82d and project 808690fdba2741df889e0a21027606f9. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:30:19.821231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:30:19.823584 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89406606-0f19-4f57-b05b-02d04ed8b39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:30:19.984440 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-442aa0db-513c-492c-9f7b-13375816c4d6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685115 Aug 18 17:30:19.985016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 590/1159] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:30:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:30:19.996382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dcf54c94-94fb-424c-a5da-2d0acb7591c2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:19.997022 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dcf54c94-94fb-424c-a5da-2d0acb7591c2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:20.052580 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-dcf54c94-94fb-424c-a5da-2d0acb7591c2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:20.059831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dcf54c94-94fb-424c-a5da-2d0acb7591c2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1241 microversion: 2.1 time: 0.067868 Aug 18 17:30:20.060391 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 570/1160] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:19 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:21.081555 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:21.082200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:21.088841 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:21.089325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:21.089764 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:21.090472 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:21.090972 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:21.091379 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:21.155219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:21.163358 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-1507389b-5b6a-4960-bade-c8f6b5e1068e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1237 microversion: 2.1 time: 0.086308 Aug 18 17:30:21.163942 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 591/1161] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:21 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:22.185500 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:22.186117 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:22.193136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:22.193553 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:22.193996 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:22.194707 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:22.195176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:22.195601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:22.407323 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:22.416407 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3d15582f-56ab-4825-94f9-d986bfbe3ec2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1299 microversion: 2.1 time: 0.234785 Aug 18 17:30:22.416983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 571/1162] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:22 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:23.437659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:23.438307 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:23.444872 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:23.445356 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:23.445794 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:23.446538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:23.449238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:23.449238 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:23.486820 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-2425f6b5-740e-4f8e-95ee-7fffaf3fbc95 req-24ef109e-50dc-441f-b61a-c5f56dd6c943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52614707-aa50-4d30-8e19-0c4565027469", "tag": "bd32ee0b-a342-4cbf-b702-9d0986eff084"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:23.496867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-2425f6b5-740e-4f8e-95ee-7fffaf3fbc95 req-24ef109e-50dc-441f-b61a-c5f56dd6c943 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:23.497348 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-2425f6b5-740e-4f8e-95ee-7fffaf3fbc95 req-24ef109e-50dc-441f-b61a-c5f56dd6c943 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:23.497780 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-2425f6b5-740e-4f8e-95ee-7fffaf3fbc95 req-24ef109e-50dc-441f-b61a-c5f56dd6c943 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:23.508850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-2425f6b5-740e-4f8e-95ee-7fffaf3fbc95 req-24ef109e-50dc-441f-b61a-c5f56dd6c943 service nova] Creating event network-changed:bd32ee0b-a342-4cbf-b702-9d0986eff084 for instance 52614707-aa50-4d30-8e19-0c4565027469 on hv-cinder-85367 Aug 18 17:30:23.514154 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-2425f6b5-740e-4f8e-95ee-7fffaf3fbc95 req-24ef109e-50dc-441f-b61a-c5f56dd6c943 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031157 Aug 18 17:30:23.514885 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 572/1163] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:30:23.722441 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:23.730029 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-78ff009a-2c15-4674-b1ac-0a4b97ea9f20 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.296274 Aug 18 17:30:23.730795 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 592/1164] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:23 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:24.751350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:24.752113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:24.758182 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:24.758659 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:24.759129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:24.759831 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:24.760280 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:24.760705 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:24.895957 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:24.903475 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-e303c463-feb6-48c7-a104-1456bc365319 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.156799 Aug 18 17:30:24.904069 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 573/1165] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:24 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:25.924044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:25.924654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:25.931614 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:25.932090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:25.932525 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:25.933218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:25.933669 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:25.934090 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:26.064349 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:26.072024 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5584268d-8557-4f13-a39b-fd7584110021 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.151892 Aug 18 17:30:26.072591 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 593/1166] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:25 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:27.092571 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:27.093178 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:27.099611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:27.100085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:27.100515 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:27.101198 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:27.101648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:27.102065 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:27.233798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:27.242079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-caa34569-b230-4710-ab0e-1defcdfec7c0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.153396 Aug 18 17:30:27.242636 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 574/1167] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:27 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:28.263075 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:28.263819 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:28.270781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:28.271292 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:28.271726 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:28.272422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:28.272874 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:28.273297 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:28.411215 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:28.418545 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4261a0cb-19ee-44bb-b265-5cff7798ef82 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.159358 Aug 18 17:30:28.419135 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 594/1168] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:28 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:29.439141 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:29.439867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:29.446473 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:29.447113 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:29.447623 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:29.448389 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:29.448909 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:29.449425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:29.584268 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:29.586565 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:29.593590 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-c07c9980-5e91-4276-a1bb-52166b3c6725 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.157957 Aug 18 17:30:29.597948 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 575/1169] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:29 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:30:30.025619 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-191e2dda-c626-4276-9bdd-bbf3790fed8d req-a8eead15-c981-4f73-a32c-0d97531e8d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52614707-aa50-4d30-8e19-0c4565027469", "name": "network-vif-plugged", "status": "completed", "tag": "bd32ee0b-a342-4cbf-b702-9d0986eff084"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:30.032251 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:30.036813 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:30.038200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-191e2dda-c626-4276-9bdd-bbf3790fed8d req-a8eead15-c981-4f73-a32c-0d97531e8d9b service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:30.038679 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-191e2dda-c626-4276-9bdd-bbf3790fed8d req-a8eead15-c981-4f73-a32c-0d97531e8d9b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:30.039132 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-191e2dda-c626-4276-9bdd-bbf3790fed8d req-a8eead15-c981-4f73-a32c-0d97531e8d9b service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:30.051459 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-191e2dda-c626-4276-9bdd-bbf3790fed8d req-a8eead15-c981-4f73-a32c-0d97531e8d9b service nova] Creating event network-vif-plugged:bd32ee0b-a342-4cbf-b702-9d0986eff084 for instance 52614707-aa50-4d30-8e19-0c4565027469 on hv-cinder-85367 Aug 18 17:30:30.057077 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-191e2dda-c626-4276-9bdd-bbf3790fed8d req-a8eead15-c981-4f73-a32c-0d97531e8d9b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Aug 18 17:30:30.057891 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 595/1170] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:30.616087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:30.616693 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:30.618921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:30.620199 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:30.625105 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:30.625582 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:30.626564 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:30.627617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:30.628130 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:30.628561 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:30.763761 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:30.773003 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ed8f0bca-6fce-46ab-8511-bef99f3296e0 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.160869 Aug 18 17:30:30.773677 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 576/1171] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:30 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:30:31.794648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:31.795409 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:31.798486 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:31.804194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:31.804677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:31.810551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:31.810551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:31.810551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:31.810551 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:31.811066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:30:31.946543 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:31.955262 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-c983e5c4-fdad-400b-a824-c7dc246330f1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1367 microversion: 2.1 time: 0.164976 Aug 18 17:30:31.955827 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 596/1172] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:31 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:32.975791 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:32.976452 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:32.984334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:32.984813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:32.985254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:32.986188 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:32.986725 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:32.987405 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:33.122013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:30:33.130947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-af62dc0e-9e9e-4565-9035-e266d222d839 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1556 microversion: 2.1 time: 0.159430 Aug 18 17:30:33.131517 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 577/1173] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:30:32 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:30:33.152197 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:30:33.152703 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:30:33.159609 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:33.160086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:33.160524 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:33.161218 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:33.161677 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:33.162087 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:33.243657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-00b97c38-d2e8-4ddb-8cb4-f2d37bcdbbfa tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096670 Aug 18 17:30:33.244246 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 597/1174] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 17:30:33 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:34.269845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-ca559a50-ba45-4ec2-a6f3-54d78cf386b1 req-7702c37c-7082-4f66-bd71-4c2b9c44ad8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52614707-aa50-4d30-8e19-0c4565027469", "tag": "bd32ee0b-a342-4cbf-b702-9d0986eff084"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:30:34.281202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ca559a50-ba45-4ec2-a6f3-54d78cf386b1 req-7702c37c-7082-4f66-bd71-4c2b9c44ad8e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:30:34.281684 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ca559a50-ba45-4ec2-a6f3-54d78cf386b1 req-7702c37c-7082-4f66-bd71-4c2b9c44ad8e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:30:34.282153 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-ca559a50-ba45-4ec2-a6f3-54d78cf386b1 req-7702c37c-7082-4f66-bd71-4c2b9c44ad8e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:30:34.294024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-ca559a50-ba45-4ec2-a6f3-54d78cf386b1 req-7702c37c-7082-4f66-bd71-4c2b9c44ad8e service nova] Creating event network-changed:bd32ee0b-a342-4cbf-b702-9d0986eff084 for instance 52614707-aa50-4d30-8e19-0c4565027469 on hv-cinder-85367 Aug 18 17:30:34.302284 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-ca559a50-ba45-4ec2-a6f3-54d78cf386b1 req-7702c37c-7082-4f66-bd71-4c2b9c44ad8e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037014 Aug 18 17:30:34.302888 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 578/1175] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:30:56.654759 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:30:56.655470 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:31:40.646177 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:31:40.646852 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=9 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:31:40.651112 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:40.651639 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:40.658417 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:40.665241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:40.665241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:40.665241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:40.665241 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:40.665664 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:40.684208 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0f8dceb6-8b25-4194-a6c1-f772dffb42f3 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/ips" status: 200 len: 148 microversion: 2.1 time: 0.039939 Aug 18 17:31:40.684771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 598/1176] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 17:31:40 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:31:42.265997 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=5 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:31:42.266742 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=15 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:31:42.271301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59245a4-a6fe-4cc6-b351-e9af65761204"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:31:42.273630 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:42.279611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:42.280089 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:42.281133 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:42.281921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:42.282374 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:42.282798 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:43.105218 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-1a8f127c-8524-4a18-9ea1-cde8dbf6f844 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "POST /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841418 Aug 18 17:31:43.106167 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 579/1177] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:31:42 2022] POST /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:31:50.731199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:50.731704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:50.735143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:31:50.739927 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:50.740403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:50.740834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:50.741523 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:50.742066 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:50.742392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:50.822662 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lazy-loading 'services' on Instance uuid 52614707-aa50-4d30-8e19-0c4565027469 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:31:50.980718 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-89d3b5a1-3ee0-4446-86d0-29d9fa5112ba tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments/a59245a4-a6fe-4cc6-b351-e9af65761204" status: 202 len: 0 microversion: 2.1 time: 0.253088 Aug 18 17:31:50.981334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 599/1178] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:31:50 2022] DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments/a59245a4-a6fe-4cc6-b351-e9af65761204 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:31:50.991267 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:50.993588 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:51.001060 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:51.001581 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:51.002014 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:51.002711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:51.003197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:51.003617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:51.033126 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4193ed7a-7e86-4101-9fb9-5615551e1299 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 18 17:31:51.033598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 580/1179] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:31:50 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:31:52.046037 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:52.048577 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:52.055231 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:52.059035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:52.059035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:52.059035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:52.059035 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:52.059486 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:52.087334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d6bf30a3-e1e5-41c6-b244-b1f343d721f4 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046062 Aug 18 17:31:52.087882 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 600/1180] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:31:52 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 17:31:52.150845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:52.151381 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:52.157687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:52.158232 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:52.158669 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:52.159386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:52.159833 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:52.160254 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:52.186366 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:31:52.481666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3bbe5512-535c-482b-9e88-7d8e7ddb9a34 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 204 len: 0 microversion: 2.1 time: 0.334473 Aug 18 17:31:52.482275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 581/1181] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:31:52 2022] DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:31:52.490757 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:52.491392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:52.497243 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:52.497714 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:52.498148 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:52.498834 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:52.499309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:52.499744 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:52.627660 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:31:52.635333 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5ce69cb4-859f-4108-b990-bf87f042b579 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1680 microversion: 2.1 time: 0.148306 Aug 18 17:31:52.635899 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 601/1182] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:31:52 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:31:53.656442 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:53.657638 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:53.664180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:53.664691 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:53.665112 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:53.665809 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:53.666266 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:53.666692 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:53.800310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:31:53.808444 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-3814628f-8207-4273-b2a4-761fdf0e829f tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1680 microversion: 2.1 time: 0.156287 Aug 18 17:31:53.809010 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 582/1183] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:31:53 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:31:54.830178 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:54.830706 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:54.836780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:54.837258 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:54.837692 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:54.838389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:54.838916 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:54.839342 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:55.052856 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:31:55.060653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-71f91e1a-3d8c-480b-a774-03272b3c573c tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1680 microversion: 2.1 time: 0.235013 Aug 18 17:31:55.061450 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 602/1184] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:31:54 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:31:55.424895 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-c1b71c81-c5d5-4e31-a7b7-5ad6f4b469e8 req-396157a5-2f03-4ffe-bafa-51531dd1e4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52614707-aa50-4d30-8e19-0c4565027469", "name": "network-vif-deleted", "tag": "bd32ee0b-a342-4cbf-b702-9d0986eff084"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:31:55.435480 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c1b71c81-c5d5-4e31-a7b7-5ad6f4b469e8 req-396157a5-2f03-4ffe-bafa-51531dd1e4b6 service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:55.435965 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c1b71c81-c5d5-4e31-a7b7-5ad6f4b469e8 req-396157a5-2f03-4ffe-bafa-51531dd1e4b6 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:55.436407 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-c1b71c81-c5d5-4e31-a7b7-5ad6f4b469e8 req-396157a5-2f03-4ffe-bafa-51531dd1e4b6 service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:55.449437 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-c1b71c81-c5d5-4e31-a7b7-5ad6f4b469e8 req-396157a5-2f03-4ffe-bafa-51531dd1e4b6 service nova] Creating event network-vif-deleted:bd32ee0b-a342-4cbf-b702-9d0986eff084 for instance 52614707-aa50-4d30-8e19-0c4565027469 on hv-cinder-85367 Aug 18 17:31:55.455508 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-c1b71c81-c5d5-4e31-a7b7-5ad6f4b469e8 req-396157a5-2f03-4ffe-bafa-51531dd1e4b6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174954 Aug 18 17:31:55.459128 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 583/1185] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:31:56.082908 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:56.083548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:56.090016 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:56.090489 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:56.090938 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:56.091637 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:56.092086 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:56.092504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:56.126984 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:56.127461 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:56.127893 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:56.128347 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.objects.instance [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lazy-loading 'fault' on Instance uuid 52614707-aa50-4d30-8e19-0c4565027469 {{(pid=121216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:31:56.172749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44ae3a4e8b41d3b8a3193db939e82d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808690fdba2741df889e0a21027606f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:31:56.183680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-ab9ed874-4fce-4bf7-8904-5e387c6c823b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 200 len: 1331 microversion: 2.1 time: 0.105728 Aug 18 17:31:56.190999 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 603/1186] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:31:56 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:31:57.208834 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:57.209535 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:57.215648 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:57.216129 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:57.216566 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:57.217261 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:57.217711 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:57.218136 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:57.232016 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 HTTP/1.1 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:31:57.233614 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:57.235372 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '52614707-aa50-4d30-8e19-0c4565027469'} Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:31:57.236215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:57.237860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:57.239305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:31:57.239305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-dc2334cd-17e3-487f-98f0-295760ed10da tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 404 len: 111 microversion: 2.1 time: 0.031581 Aug 18 17:31:57.239305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 584/1187] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:31:57 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:31:57.244203 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6de03483-26db-4ae6-b1fb-df1656946da1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '.version_select at 0x7fd1fb576ca0>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:57.318327 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6de03483-26db-4ae6-b1fb-df1656946da1 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991756767" status: 202 len: 0 microversion: 2.1 time: 0.077795 Aug 18 17:31:57.318892 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 604/1188] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 17:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991756767 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:31:59.265548 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:59.266772 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:59.273293 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:59.273775 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:59.274209 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:59.274920 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:59.275376 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:59.275799 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:59.289650 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 HTTP/1.1 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:31:59.291220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.292875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '52614707-aa50-4d30-8e19-0c4565027469'} Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:31:59.293869 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.295436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.297047 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:31:59.297047 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bb829539-6516-4d94-a73e-b057ac917f66 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 404 len: 111 microversion: 2.1 time: 0.030885 Aug 18 17:31:59.297047 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 585/1189] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:31:59 2022] DELETE /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:31:59.301931 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:31:59.302549 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 52614707-aa50-4d30-8e19-0c4565027469] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:31:59.309117 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:59.309594 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:59.310071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:59.310743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:31:59.311219 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:31:59.311644 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:31:59.324430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 HTTP/1.1 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:31:59.326055 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.327745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '52614707-aa50-4d30-8e19-0c4565027469'} Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:31:59.329426 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. Aug 18 17:31:59.331200 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:31:59.332567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 52614707-aa50-4d30-8e19-0c4565027469 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:31:59.332567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-68f3ef5b-ebd5-4332-b231-521903aaec32 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469" status: 404 len: 111 microversion: 2.1 time: 0.030348 Aug 18 17:31:59.332567 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 605/1190] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:31:59 2022] GET /compute/v2.1/servers/52614707-aa50-4d30-8e19-0c4565027469 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:32:00.607100 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:32:00.607603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:32:00.614569 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.615085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.615527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.616217 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.616667 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.617092 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.630874 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d HTTP/1.1 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:32:00.632419 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.634055 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '36377547-972d-4cfa-b9db-abc82887b87d'} Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:32:00.635189 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.636749 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.638362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:32:00.638362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-2d44c8e2-952f-4a6d-906f-918841e1db8e tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 404 len: 111 microversion: 2.1 time: 0.030628 Aug 18 17:32:00.638362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 586/1191] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:32:00 2022] DELETE /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:32:00.642156 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:32:00.642802 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 36377547-972d-4cfa-b9db-abc82887b87d] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:32:00.649245 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.649720 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.650155 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.650843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.651329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.651759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.665289 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d HTTP/1.1 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:32:00.666786 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.668460 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '36377547-972d-4cfa-b9db-abc82887b87d'} Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:32:00.669444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. Aug 18 17:32:00.670721 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.672068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 36377547-972d-4cfa-b9db-abc82887b87d could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:32:00.672068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e6e550f3-37a9-4988-b703-548eeec6c6d2 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d" status: 404 len: 111 microversion: 2.1 time: 0.030023 Aug 18 17:32:00.672068 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 606/1192] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:32:00 2022] GET /compute/v2.1/servers/36377547-972d-4cfa-b9db-abc82887b87d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:32:00.677627 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:32:00.678126 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:32:00.684124 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.684603 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.685040 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.685724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.686172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.686594 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.699792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 HTTP/1.1 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:32:00.701301 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.702921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': 'ec039f68-067d-4759-bbe9-fa09aadb69e6'} Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:32:00.703971 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.705534 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.707425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:32:00.707425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-82f20fc7-cc18-43dd-a0f6-faf939f151eb tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 404 len: 111 microversion: 2.1 time: 0.030038 Aug 18 17:32:00.707425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 587/1193] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:32:00 2022] DELETE /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:32:00.710657 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:32:00.711299 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: ec039f68-067d-4759-bbe9-fa09aadb69e6] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:32:00.717163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.717635 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.718067 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.718750 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:00.719235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:00.719656 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:00.733206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 HTTP/1.1 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:32:00.734687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.736338 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': 'ec039f68-067d-4759-bbe9-fa09aadb69e6'} Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:32:00.737475 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. Aug 18 17:32:00.740164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:00.741537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance ec039f68-067d-4759-bbe9-fa09aadb69e6 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:32:00.741537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e7a53332-7099-4507-82f2-6a9028a25ef6 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6" status: 404 len: 111 microversion: 2.1 time: 0.029068 Aug 18 17:32:00.741537 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 607/1194] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:32:00 2022] GET /compute/v2.1/servers/ec039f68-067d-4759-bbe9-fa09aadb69e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:32:02.008617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:32:02.009122 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:32:02.015618 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:02.017197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:02.017197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:02.017197 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:02.017660 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:02.018086 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:02.032180 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.wsgi [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: request: DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 HTTP/1.1 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept: application/json Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Accept-Encoding: identity Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Connection: close Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Length: 0 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Content-Type: application/json Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Host: 10.222.0.82 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Openstack-System-Scope: None Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: User-Agent: python-urllib3/1.26.11 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Id: None Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Domain-Name: None Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Identity-Status: Confirmed Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Is-Admin-Project: True Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Id: default Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Domain-Name: Default Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Role: member,reader Aug 18 17:32:02.033649 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Roles: member,reader Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Id: default Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Domain-Name: Default Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: method: > Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: exception: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.036033 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: action_args: {'id': '8dcb74ce-bd3d-4943-9d28-4159511befb7'} Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:32:02.036969 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.038514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.040101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. {{(pid=121217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:32:02.040101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-50d02021-0d6a-4850-9cfe-8b59dd79eb54 tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 404 len: 111 microversion: 2.1 time: 0.030918 Aug 18 17:32:02.040101 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 588/1195] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:32:02 2022] DELETE /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:32:02.043980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:32:02.045947 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] [instance: 8dcb74ce-bd3d-4943-9d28-4159511befb7] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:32:02.052052 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:02.052538 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:02.053224 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:02.053659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:32:02.054115 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:32:02.054548 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:32:02.068446 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] HTTP exception thrown: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Request method failure captured: Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 HTTP/1.1 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nXP2hduHcFOpyyi6robFZHgbLZJvpBnFMHwAHp04AfhHK424ajYp---vwl9bvGC3_GLTJKwMIyUL-AVd4JTFnDA32dzz232U243YtPUwu6ke8elEtpTN2IhSRwNUjsz_9mrJRLXurfrUnndatR8bh7PcyO2pBFf7OVmksc1LLDnwR4 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:32:02.069963 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_808690fdba2741df889e0a21027606f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/808690fdba2741df889e0a21027606f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/808690fdba2741df889e0a21027606f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 808690fdba2741df889e0a21027606f9 Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1833743491 Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: da44ae3a4e8b41d3b8a3193db939e82d Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-AttachVolumeNegativeTest-1833743491-project Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.071715 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '8dcb74ce-bd3d-4943-9d28-4159511befb7'} Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:32:02.076051 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. Aug 18 17:32:02.078154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:32:02.079704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] Returning 404 to user: Instance 8dcb74ce-bd3d-4943-9d28-4159511befb7 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:32:02.079704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0ea59231-a054-42c4-a256-9525705ed07b tempest-AttachVolumeNegativeTest-1833743491 tempest-AttachVolumeNegativeTest-1833743491-project] 10.222.0.82 "GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7" status: 404 len: 111 microversion: 2.1 time: 0.031185 Aug 18 17:32:02.079704 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 608/1196] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:32:02 2022] GET /compute/v2.1/servers/8dcb74ce-bd3d-4943-9d28-4159511befb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:33:31.341634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:31.342376 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:31.346307 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-93c6bde4-fb70-48a2-83e0-99d3fe14035c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Action: 'create', calling method: .version_select at 0x7fd1f2d7af70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-655959014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmAbI1JwcmMU0ixZd9TCgCpNqExImfhBeNJsFVgGhCpFcHRsjibERCbBGxiA6Q9RVc4TtxWplnhc5WtMiWZH2Fm9r8b506zwg1ntIgvh8Gy3SsGC+gz0RWptwZrfznLgQ=="}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:33:31.361829 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-93c6bde4-fb70-48a2-83e0-99d3fe14035c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Getting quotas for project 310d5ca0d33441a4ad074b88dbcb715e. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:33:31.365620 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.quota [None req-93c6bde4-fb70-48a2-83e0-99d3fe14035c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Getting quotas for user f4f3b121e4c444cb961bf9e1c23bf741 and project 310d5ca0d33441a4ad074b88dbcb715e. Resources: {'key_pairs'} {{(pid=121217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:33:31.438555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-93c6bde4-fb70-48a2-83e0-99d3fe14035c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.098688 Aug 18 17:33:31.439204 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 589/1197] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 17:33:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:33:31.487550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:31.488263 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:31.492164 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1010400841", "imageRef": "8d206eed-1b39-47dc-98f3-b3b97c73804d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-655959014", "networks": [{"uuid": "aca63e8a-4dec-4502-bfd7-653ed0456b9b"}]}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:33:31.651640 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.network.neutron [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] validate_networks() for [('aca63e8a-4dec-4502-bfd7-653ed0456b9b', None, None, None, None, None)] {{(pid=121216) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:33:32.110353 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Flavor limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:33:32.110776 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Image limits 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:33:32.111284 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Flavor pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:33:32.111694 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Image pref 0:0:0 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:33:32.112161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.virt.hardware [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:33:32.120843 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:32.121317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:32.121748 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:32.122472 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:32.122948 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:32.123375 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:32.140375 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Getting quotas for project 310d5ca0d33441a4ad074b88dbcb715e. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:33:32.145042 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.quota [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Getting quotas for user f4f3b121e4c444cb961bf9e1c23bf741 and project 310d5ca0d33441a4ad074b88dbcb715e. Resources: {'instances', 'ram', 'cores'} {{(pid=121216) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:33:32.155689 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Going to run 1 instances... {{(pid=121216) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:33:32.157874 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d206eed-1b39-47dc-98f3-b3b97c73804d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:33:32.273806 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d207332b-592f-4e1a-af30-a907e4103667 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788275 Aug 18 17:33:32.274601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 609/1198] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 17:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:33:32.286382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9c5e6fc9-649e-4665-9017-015ccbdad571 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:32.291483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9c5e6fc9-649e-4665-9017-015ccbdad571 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:32.405734 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9c5e6fc9-649e-4665-9017-015ccbdad571 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:32.413505 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9c5e6fc9-649e-4665-9017-015ccbdad571 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1258 microversion: 2.1 time: 0.131901 Aug 18 17:33:32.414056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 590/1199] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:32 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1258 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:33.433550 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:33.434093 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:33.441627 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:33.442085 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:33.442519 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:33.443254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:33.443755 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:33.444189 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:33.505154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:33.514493 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-79fedab3-b9f9-4c2a-9652-9f109dc97dcf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1262 microversion: 2.1 time: 0.084802 Aug 18 17:33:33.516168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 610/1200] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:33 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:34.536242 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:34.536854 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:34.543778 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:34.544315 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:34.544747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:34.545443 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:34.545898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:34.546367 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:34.627087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:34.635513 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9f731b75-f672-4de5-9e07-d3ffea24b5a2 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1318 microversion: 2.1 time: 0.103701 Aug 18 17:33:34.636092 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 591/1201] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:34 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:35.661190 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:35.661869 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:35.669233 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:35.669713 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:35.670147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:35.670853 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:35.671403 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:35.671781 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:35.824980 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:35.833471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-5283b35b-1c28-44d2-aa1c-daa553771245 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.177249 Aug 18 17:33:35.842956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 611/1202] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:35 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:36.860983 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:36.861733 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:36.869897 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:36.870637 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:36.871289 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:36.872028 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:36.872483 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:36.872936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:37.013144 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:37.023148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-4199256b-8bcc-4414-9746-c0dc58a52272 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.165897 Aug 18 17:33:37.023905 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 592/1203] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:36 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:38.044597 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:38.046018 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:38.053659 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:38.054157 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:38.054601 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:38.055343 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:38.055801 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:38.056235 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:38.199031 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:38.206784 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-44102d77-de18-436f-b23a-89a7fb5ba620 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.166014 Aug 18 17:33:38.207645 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 612/1204] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:38 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:39.227785 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:39.228504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:39.235382 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:39.235873 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:39.236312 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:39.237531 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:39.237994 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:39.238412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:39.372744 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:39.382163 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0a56d8e8-e9ad-4a34-942a-e9a1e943aea3 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.158413 Aug 18 17:33:39.382960 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 593/1205] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:39 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:40.403855 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:40.404469 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:40.412515 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:40.413084 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:40.413602 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:40.414385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:40.414935 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:40.415432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:40.555974 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:40.565205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7a66fddd-e7a0-414e-bcb8-83bc8424013e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.165231 Aug 18 17:33:40.566487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 613/1206] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:40 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:41.588974 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:41.589979 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:41.598714 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:41.599310 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:41.600019 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:41.608555 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:41.609104 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:41.609567 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:42.046434 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:42.056088 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-9bd073a3-e35f-4cf6-836b-332892a3cc38 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.472250 Aug 18 17:33:42.056922 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 594/1207] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:41 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:43.076992 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:43.077600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:43.079887 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=2 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:43.080579 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell0:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:43.085272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:43.085743 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:43.086175 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:43.086858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:43.087325 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:43.087745 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:43.216383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:43.224205 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-114d0324-4729-434e-88e8-41d5e4a52d53 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.151015 Aug 18 17:33:43.224770 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 614/1208] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:43 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:44.245281 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:44.245936 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:44.247731 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=6 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:33:44.253601 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:44.255083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:44.255083 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:44.255402 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:44.255884 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:44.256306 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:44.389497 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:44.398085 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-32f6e50b-2bcb-406e-b495-aed186599d33 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.156660 Aug 18 17:33:44.398656 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 595/1209] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:44 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:45.418772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:45.419430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:45.425902 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:45.426632 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:45.427104 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:45.427797 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:45.428248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:45.428673 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:45.601826 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:45.609960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7f3fbf5d-74c3-493a-8b77-7e3e97236023 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.194949 Aug 18 17:33:45.616851 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 615/1210] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:45 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:46.259453 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-7dfab0de-189b-494a-ad91-26b53f0ae7f8 req-bece74b6-abd2-4a3c-8b9f-413e4ee12bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:33:46.271527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7dfab0de-189b-494a-ad91-26b53f0ae7f8 req-bece74b6-abd2-4a3c-8b9f-413e4ee12bec service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:46.272005 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7dfab0de-189b-494a-ad91-26b53f0ae7f8 req-bece74b6-abd2-4a3c-8b9f-413e4ee12bec service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:46.272436 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-7dfab0de-189b-494a-ad91-26b53f0ae7f8 req-bece74b6-abd2-4a3c-8b9f-413e4ee12bec service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:46.283862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-7dfab0de-189b-494a-ad91-26b53f0ae7f8 req-bece74b6-abd2-4a3c-8b9f-413e4ee12bec service nova] Creating event network-changed:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:33:46.289552 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-7dfab0de-189b-494a-ad91-26b53f0ae7f8 req-bece74b6-abd2-4a3c-8b9f-413e4ee12bec service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035759 Aug 18 17:33:46.290350 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 596/1211] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:33:46.630661 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:46.631389 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:46.637772 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:46.638249 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:46.638686 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:46.639402 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:46.639858 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:46.640280 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:46.844598 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:46.853314 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4eb17218-1174-49da-a3c5-8728e16cb762 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.226561 Aug 18 17:33:46.853888 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 616/1212] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:46 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:47.875125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:47.875867 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:47.882670 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:47.883179 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:47.883617 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:47.884311 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:47.884767 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:47.885186 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:48.012605 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:48.021015 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-aa5028cc-7f1e-460c-8c50-82e4f14f382d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.150553 Aug 18 17:33:48.021520 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 597/1213] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:47 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:49.041410 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:49.042048 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:49.048313 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:49.048784 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:49.049214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:49.049901 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:49.050479 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:49.050844 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:49.185765 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:49.194634 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d6e75eb7-11b4-4d0e-8e45-f7622e4d7dda tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.157042 Aug 18 17:33:49.195248 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 617/1214] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:49 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:50.216172 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:50.216787 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:50.223323 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:50.223850 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:50.224282 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:50.224973 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:50.225425 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:50.225848 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:50.351946 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:50.359720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-88998fc6-b5de-4896-859e-4518c6084893 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.147488 Aug 18 17:33:50.360462 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 598/1215] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:50 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:51.106254 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-398c0f01-f8b4-4f4e-a529-991675b69a02 req-f1fd763e-dd4f-4802-88a6-42f4b7930c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "name": "network-vif-plugged", "status": "completed", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:33:51.116861 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-398c0f01-f8b4-4f4e-a529-991675b69a02 req-f1fd763e-dd4f-4802-88a6-42f4b7930c8e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:51.117326 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-398c0f01-f8b4-4f4e-a529-991675b69a02 req-f1fd763e-dd4f-4802-88a6-42f4b7930c8e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:51.117749 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-398c0f01-f8b4-4f4e-a529-991675b69a02 req-f1fd763e-dd4f-4802-88a6-42f4b7930c8e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:51.130173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-398c0f01-f8b4-4f4e-a529-991675b69a02 req-f1fd763e-dd4f-4802-88a6-42f4b7930c8e service nova] Creating event network-vif-plugged:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:33:51.135504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-398c0f01-f8b4-4f4e-a529-991675b69a02 req-f1fd763e-dd4f-4802-88a6-42f4b7930c8e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033076 Aug 18 17:33:51.136089 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 618/1216] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:33:51.380961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:51.381576 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:51.388334 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:51.388821 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:51.389257 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:51.389970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:51.390416 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:51.390840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:51.567995 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:51.575952 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-183c92af-85c7-4d9a-97a1-6e8835bd9f6f tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.199072 Aug 18 17:33:51.576527 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 599/1217] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:51 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:52.598318 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:52.599044 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:52.605337 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:52.605808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:52.606236 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:52.606964 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:52.607418 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:52.607837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:52.735309 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:52.743384 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-4c115da9-535d-4283-9038-974358562c2e tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1358 microversion: 2.1 time: 0.149966 Aug 18 17:33:52.743955 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 619/1218] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:52 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:53.763982 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:53.764596 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:53.771598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:53.772068 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:53.772495 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:53.773185 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:53.773634 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:53.774051 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:53.905720 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:53.913861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-038688a8-5f62-4539-8670-0a7da48bc627 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1548 microversion: 2.1 time: 0.153769 Aug 18 17:33:53.914432 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 600/1219] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:53 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:33:53.934470 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:53.935136 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:53.941331 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:53.941812 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:53.942240 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:53.942944 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:53.943400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:53.943829 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:54.068651 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:54.076206 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-3d65b9ef-f3b8-4266-afc0-a9d7b188eeb6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1548 microversion: 2.1 time: 0.145590 Aug 18 17:33:54.076771 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 620/1220] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:53 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:54.095559 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:54.100769 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:54.101532 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Searching by: {'deleted': False, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e'} {{(pid=121217) get_all /opt/stack/nova/nova/compute/api.py:3007}} Aug 18 17:33:54.108030 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:54.108504 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:54.108937 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:54.109666 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:54.110121 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:54.110544 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:54.200045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.multi_cell_list [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121217) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 17:33:54.297622 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-32ae2f31-5894-4144-807f-9b6e5ab7bcff tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205753 Aug 18 17:33:54.298221 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 601/1221] 10.222.0.82 () {58 vars in 1125 bytes} [Thu Aug 18 17:33:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:33:54.309729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:33:54.310376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:54.316291 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:54.316760 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:54.317194 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:54.317883 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:54.318334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:54.318759 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:54.446600 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:33:54.454271 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-66851a00-25f2-44fc-acd8-9293b0f451a8 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1548 microversion: 2.1 time: 0.148373 Aug 18 17:33:54.454828 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 621/1222] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:33:54 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:33:56.358045 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:33:56.360336 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:33:56.367118 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:56.367595 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:56.368041 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:56.368707 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:33:56.369152 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:33:56.369571 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:33:57.024485 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-7179ea34-c54c-4877-9b85-09bba51f91c4 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670170 Aug 18 17:33:57.025016 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 602/1223] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 17:33:56 2022] POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:34:04.605556 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:34:04.606165 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:34:04.608783 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:34:04.609599 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=70 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:34:04.615034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:04.619429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:04.619429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:04.619429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:04.619429 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:04.619837 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:04.748478 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:34:04.756653 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7d782d43-3bbc-4b70-8c83-a3cd3ad75d46 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1594 microversion: 2.1 time: 0.154939 Aug 18 17:34:04.757209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 622/1224] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:34:04 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:34:06.653575 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell0:SELECT=2 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:34:06.654610 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:34:06.659438 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-474c184b-3e43-489f-9c8f-08839b655f47 req-085c2340-eb63-401e-8624-e541bc35882c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:34:06.671706 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-474c184b-3e43-489f-9c8f-08839b655f47 req-085c2340-eb63-401e-8624-e541bc35882c service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:06.672347 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-474c184b-3e43-489f-9c8f-08839b655f47 req-085c2340-eb63-401e-8624-e541bc35882c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:06.672880 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-474c184b-3e43-489f-9c8f-08839b655f47 req-085c2340-eb63-401e-8624-e541bc35882c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:06.677077 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:34:06.688803 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-474c184b-3e43-489f-9c8f-08839b655f47 req-085c2340-eb63-401e-8624-e541bc35882c service nova] Creating event network-changed:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:34:06.694718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-474c184b-3e43-489f-9c8f-08839b655f47 req-085c2340-eb63-401e-8624-e541bc35882c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042383 Aug 18 17:34:06.695482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 603/1225] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:34:08.911547 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-861722368"}} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:34:08.912432 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:34:08.918866 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:08.919383 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:08.919811 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:08.920504 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:08.920956 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:08.921406 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:09.046808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.network.security_group_api [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Adding security group ada7a790-79e3-43a4-9445-2ef953f8a513 to port 60b74d01-915c-411d-9bfa-cb5153c2409f Aug 18 17:34:09.647444 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-7dc5ad41-5f95-4cfe-a749-730a367859cc tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/action" status: 202 len: 0 microversion: 2.1 time: 0.739480 Aug 18 17:34:09.648431 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 623/1226] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:34:08 2022] POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:34:09.657050 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-79cc1299-9115-46f5-9004-72d8bc99a53c req-a6fbd0cb-a244-4fb5-8c90-241d5c0d744c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:34:09.657616 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:34:09.658390 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:34:09.666225 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:09.667139 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:09.667928 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:09.669034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:09.669229 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-79cc1299-9115-46f5-9004-72d8bc99a53c req-a6fbd0cb-a244-4fb5-8c90-241d5c0d744c service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:34:09.670799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:09.671044 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-79cc1299-9115-46f5-9004-72d8bc99a53c req-a6fbd0cb-a244-4fb5-8c90-241d5c0d744c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:34:09.671487 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:09.671876 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-79cc1299-9115-46f5-9004-72d8bc99a53c req-a6fbd0cb-a244-4fb5-8c90-241d5c0d744c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:34:09.686891 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-79cc1299-9115-46f5-9004-72d8bc99a53c req-a6fbd0cb-a244-4fb5-8c90-241d5c0d744c service nova] Creating event network-changed:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:34:09.693862 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-79cc1299-9115-46f5-9004-72d8bc99a53c req-a6fbd0cb-a244-4fb5-8c90-241d5c0d744c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040747 Aug 18 17:34:09.695463 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 604/1227] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:34:09.921004 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:34:09.932392 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-b3bd959c-7313-4f59-b391-2a96cef49eee tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1758 microversion: 2.1 time: 0.278950 Aug 18 17:34:09.933062 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 624/1228] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:34:09 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1758 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:34:16.663841 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:34:16.664860 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:34:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:35:07.373695 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:35:07.376007 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:07.383441 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:07.383926 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:07.384366 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:07.385067 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:07.385521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:07.385947 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:07.576789 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-0922a2dd-b203-41bb-8d32-19c351ff7517 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/action" status: 202 len: 0 microversion: 2.1 time: 0.207512 Aug 18 17:35:07.578013 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 605/1229] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:35:07 2022] POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:35:07.586169 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:07.586777 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:07.588774 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=6 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:35:07.589471 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=16 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:35:07.594875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:07.595388 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:07.595820 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:07.596522 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:07.596972 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:07.597400 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:07.798953 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:07.807406 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0da73073-3969-4995-b7e4-73bb1b5b50bf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1750 microversion: 2.1 time: 0.225217 Aug 18 17:35:07.807960 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 625/1230] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:07 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1750 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:08.830754 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:08.831482 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:08.837674 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:08.838148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:08.838579 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:08.839299 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:08.839747 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:08.840171 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:08.983110 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:08.991611 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cccebdb8-4ad1-4545-bfae-8da8e9c2cfad tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.166341 Aug 18 17:35:08.992173 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 606/1231] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:08 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:10.018430 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:10.019071 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:10.025832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:10.026305 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:10.026751 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:10.027472 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:10.027914 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:10.028329 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:10.175274 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:10.183773 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-8d2a2216-2a5c-47d5-9ff6-13409dc6c2c6 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.169279 Aug 18 17:35:10.184334 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 626/1232] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:10 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:11.205680 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:11.206290 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:11.212881 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:11.213362 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:11.213800 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:11.214499 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:11.214986 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:11.215414 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:11.358329 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:11.367158 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-994898d6-3488-4679-9dbe-1e51c784c6ab tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.165364 Aug 18 17:35:11.367724 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 607/1233] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:11 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:12.387916 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:12.388502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:12.395266 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:12.395746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:12.396180 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:12.396875 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:12.397332 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:12.397757 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:12.537981 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:12.546147 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-6f6495c0-80d2-48df-91e0-89c9f347d8a1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.162081 Aug 18 17:35:12.546712 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 627/1234] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:12 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:13.567514 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:13.568131 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:13.574538 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:13.575052 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:13.575491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:13.576183 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:13.576631 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:13.577062 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:13.721227 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:13.729907 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-ac98b0bb-2a36-46b3-b1a5-8c156da1baa1 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.166392 Aug 18 17:35:13.730472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 608/1235] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:13 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:14.751536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:14.752143 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:14.759163 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:14.759641 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:14.760110 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:14.760799 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:14.761247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:14.761671 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:14.900672 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:14.908808 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-466832e3-b6a6-4dcf-8bc9-bac084b43857 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.161162 Aug 18 17:35:14.909366 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 628/1236] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:14 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:15.929721 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:15.930332 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:15.936723 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:15.937202 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:15.937640 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:15.938326 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:15.938776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:15.939219 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:16.085187 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:16.093275 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-784654bc-214c-40c2-8ffa-1eb3080ffc16 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.167644 Aug 18 17:35:16.093832 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 609/1237] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:15 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:17.113680 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:17.114422 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:17.121257 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:17.121729 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:17.122161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:17.122844 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:17.123320 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:17.123742 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:17.267919 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:17.276832 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-744580be-3c19-4c04-8c36-7dbe30005e32 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.167069 Aug 18 17:35:17.277394 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 629/1238] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:17 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:18.297845 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:18.298491 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:18.305415 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:18.305898 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:18.306339 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:18.307061 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:18.307521 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:18.307949 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:18.448148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:18.456450 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-b26770d2-3f21-4c53-a19f-8d1269feb687 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1755 microversion: 2.1 time: 0.162425 Aug 18 17:35:18.457027 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 610/1239] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:18 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:35:19.478847 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:35:19.479418 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:35:19.485850 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:19.486317 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:19.486746 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:19.487515 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:35:19.487958 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:35:19.490247 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:35:19.635413 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:35:19.643495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-e8339386-677f-4223-9869-0c8214246322 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1758 microversion: 2.1 time: 0.168654 Aug 18 17:35:19.644046 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 630/1240] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:35:19 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:36:22.960060 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_api:SELECT=16 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:36:22.960861 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG dbcounter [-] [121217] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:36:22.964813 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-861722368"}} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:36:22.965340 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:22.971132 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:22.978815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:22.978815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:22.978815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:22.978815 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:22.979253 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:23.101961 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.network.security_group_api [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Removing security group ada7a790-79e3-43a4-9445-2ef953f8a513 from port 60b74d01-915c-411d-9bfa-cb5153c2409f Aug 18 17:36:23.449795 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-bbc79f36-b6e9-4a3b-aadc-e9c696d7b1eb tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/action" status: 202 len: 0 microversion: 2.1 time: 0.491748 Aug 18 17:36:23.450598 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 611/1241] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 17:36:22 2022] POST /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:36:23.477528 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_api:SELECT=12 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:36:23.478945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG dbcounter [-] [121216] Writing DB stats nova_cell1:SELECT=36 {{(pid=121216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:36:23.482295 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [req-2e4fb59e-67f6-429e-9c9d-1665b371f8a4 req-6ba6ecb0-9354-4d12-bf68-18409dbe979c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:36:23.499168 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-2e4fb59e-67f6-429e-9c9d-1665b371f8a4 req-6ba6ecb0-9354-4d12-bf68-18409dbe979c service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:23.499648 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-2e4fb59e-67f6-429e-9c9d-1665b371f8a4 req-6ba6ecb0-9354-4d12-bf68-18409dbe979c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:23.500072 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [req-2e4fb59e-67f6-429e-9c9d-1665b371f8a4 req-6ba6ecb0-9354-4d12-bf68-18409dbe979c service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:23.527335 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.compute.server_external_events [req-2e4fb59e-67f6-429e-9c9d-1665b371f8a4 req-6ba6ecb0-9354-4d12-bf68-18409dbe979c service nova] Creating event network-changed:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:36:23.532796 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [req-2e4fb59e-67f6-429e-9c9d-1665b371f8a4 req-6ba6ecb0-9354-4d12-bf68-18409dbe979c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057723 Aug 18 17:36:23.533687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 631/1242] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:36:25.117445 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:25.118000 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:25.123910 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:25.124384 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:25.124809 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:25.125507 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:25.125933 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:25.126342 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:25.209250 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.objects.instance [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lazy-loading 'services' on Instance uuid 4b4cac5b-7983-47a0-a0bb-d338610531e4 {{(pid=121217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:36:25.412472 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-32a08945-9b73-4572-8b48-96ddadfe6a66 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments/b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32" status: 202 len: 0 microversion: 2.1 time: 0.300461 Aug 18 17:36:25.413565 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 612/1243] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:36:25 2022] DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments/b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:36:25.422982 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:25.425884 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:25.433585 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:25.434064 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:25.434684 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:25.435435 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:25.435878 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:25.436296 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:25.468083 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-9e6deb68-8c63-4bdf-a5bd-988e49330712 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049930 Aug 18 17:36:25.468651 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 632/1244] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:36:25 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:36:25.548818 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-002005d7-13ba-4445-891f-803fdbb8df1a req-433abfec-02b1-44e1-b6b2-9bea116e5c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:36:25.561314 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-002005d7-13ba-4445-891f-803fdbb8df1a req-433abfec-02b1-44e1-b6b2-9bea116e5c2e service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:25.561792 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-002005d7-13ba-4445-891f-803fdbb8df1a req-433abfec-02b1-44e1-b6b2-9bea116e5c2e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:25.562220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-002005d7-13ba-4445-891f-803fdbb8df1a req-433abfec-02b1-44e1-b6b2-9bea116e5c2e service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:25.575176 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-002005d7-13ba-4445-891f-803fdbb8df1a req-433abfec-02b1-44e1-b6b2-9bea116e5c2e service nova] Creating event network-changed:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:36:25.580125 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-002005d7-13ba-4445-891f-803fdbb8df1a req-433abfec-02b1-44e1-b6b2-9bea116e5c2e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035575 Aug 18 17:36:25.580714 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 613/1245] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:36:26.482053 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:26.484199 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:26.491159 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:26.491687 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:26.492120 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:26.492815 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:26.493265 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:26.493719 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:26.524146 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-0e07fc61-7200-4cae-b223-8a68759bd802 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Aug 18 17:36:26.524676 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 633/1246] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:36:26 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:36:27.537412 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:27.540220 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:27.546388 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:27.546875 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:27.547346 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:27.548038 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:27.548496 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:27.548925 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:27.577127 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-83c710e1-b62f-4d0b-a177-170a79bc4a8d tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044525 Aug 18 17:36:27.577700 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 614/1247] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 17:36:27 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:36:27.588109 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:27.588611 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:27.595217 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:27.595695 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:27.596129 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:27.596823 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:27.597272 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:27.597698 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:27.672324 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] HTTP exception thrown: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 is not attached to volume b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Request method failure captured: Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments/b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 HTTP/1.1 Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nfa_fFAbjkUGtOke8PauLBfDTzI7e3yU9f4IwbqXckBmgDmCyJ8GAOB128PbyLffOoWtQASdtNTCXuatUWH57dvhoReYYRFtrWpfGMfEL6UB1rCyIiGgT00QmK06mfNlCK4d4V5py81B5IPTHVTzOH5NmcxdRNFKG5KI7K9iYol8Xw Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 310d5ca0d33441a4ad074b88dbcb715e Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-TestMinimumBasicScenario-946347483 Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:36:27.674707 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-TestMinimumBasicScenario-946347483 Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 310d5ca0d33441a4ad074b88dbcb715e Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-TestMinimumBasicScenario-946347483 Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-TestMinimumBasicScenario-946347483-project Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: f4f3b121e4c444cb961bf9e1c23bf741 Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-TestMinimumBasicScenario-946347483-project Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:36:27.676505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 is not attached to volume b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'server_id': '4b4cac5b-7983-47a0-a0bb-d338610531e4', 'id': 'b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32'} Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32. Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:36:27.677862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 is not attached to volume b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 is not attached to volume b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:27.679561 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Returning 404 to user: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 is not attached to volume b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:36:27.680873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-d45eea8c-cb0f-4ea1-836d-eb647d7d51c7 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments/b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32" status: 404 len: 154 microversion: 2.1 time: 0.092239 Aug 18 17:36:27.680873 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 634/1248] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 17:36:27 2022] DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4/os-volume_attachments/b0f5dc39-9a2b-4c20-bd8f-c1b0b0bcea32 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:36:28.940305 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:28.940797 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:28.947435 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:28.947921 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:28.948386 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:28.949087 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:28.949542 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:28.949970 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:28.973676 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Going to try to terminate instance {{(pid=121217) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:36:29.288373 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-f36130ee-43a8-4393-849a-9073ea736e41 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 204 len: 0 microversion: 2.1 time: 0.350973 Aug 18 17:36:29.288932 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 615/1249] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 17:36:28 2022] DELETE /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:36:29.297161 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:29.297778 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:29.304998 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:29.305502 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:29.305937 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:29.306629 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:29.307116 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:29.307536 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:29.436385 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:36:29.444654 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-a113e594-d67b-4024-ab50-717ccda649cf tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1554 microversion: 2.1 time: 0.150776 Aug 18 17:36:29.445209 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 635/1250] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:36:29 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:36:30.467024 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:30.467753 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.compute.api [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121217) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:30.474056 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:30.474529 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:30.475501 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:30.476212 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:30.476661 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:30.477079 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:30.609908 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.policy [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:36:30.618278 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-cd8ff991-c382-4657-b579-f72c33e4c78c tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1554 microversion: 2.1 time: 0.156414 Aug 18 17:36:30.618840 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 616/1251] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:36:30 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:36:31.639932 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:31.640495 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:31.646940 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:31.650505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:31.650505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:31.650505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:31.650505 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:31.651034 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:31.815196 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.policy [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f3b121e4c444cb961bf9e1c23bf741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310d5ca0d33441a4ad074b88dbcb715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121216) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:36:31.829170 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-2e43dc8d-733f-4c4c-8356-523a77831d01 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 200 len: 1554 microversion: 2.1 time: 0.193121 Aug 18 17:36:31.835228 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 636/1252] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:36:31 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:36:31.879236 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [req-06f87226-7797-4a6d-a803-591e5cea6a46 req-422c6a27-94c3-4a3a-97b0-5688c58e957f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4cac5b-7983-47a0-a0bb-d338610531e4", "name": "network-vif-deleted", "tag": "60b74d01-915c-411d-9bfa-cb5153c2409f"}]} {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:36:31.889215 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-06f87226-7797-4a6d-a803-591e5cea6a46 req-422c6a27-94c3-4a3a-97b0-5688c58e957f service nova] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:31.889687 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-06f87226-7797-4a6d-a803-591e5cea6a46 req-422c6a27-94c3-4a3a-97b0-5688c58e957f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:31.890168 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG oslo_concurrency.lockutils [req-06f87226-7797-4a6d-a803-591e5cea6a46 req-422c6a27-94c3-4a3a-97b0-5688c58e957f service nova] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:31.901193 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.compute.server_external_events [req-06f87226-7797-4a6d-a803-591e5cea6a46 req-422c6a27-94c3-4a3a-97b0-5688c58e957f service nova] Creating event network-vif-deleted:60b74d01-915c-411d-9bfa-cb5153c2409f for instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 on hv-cinder-85367 Aug 18 17:36:31.906149 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [req-06f87226-7797-4a6d-a803-591e5cea6a46 req-422c6a27-94c3-4a3a-97b0-5688c58e957f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030760 Aug 18 17:36:31.906727 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 617/1253] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 17:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:36:32.849586 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '>' {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:32.850230 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.compute.api [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] [instance: 4b4cac5b-7983-47a0-a0bb-d338610531e4] Fetching instance by UUID {{(pid=121216) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:36:32.856862 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:32.857346 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:32.857780 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:32.858477 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Acquiring lock "baddab50-6834-47ff-9a53-35237c9c57ce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:36:32.858945 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:36:32.859376 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG oslo_concurrency.lockutils [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Lock "baddab50-6834-47ff-9a53-35237c9c57ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:36:32.872316 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.wsgi [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] HTTP exception thrown: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 could not be found. Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Request method failure captured: Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: request: GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 HTTP/1.1 Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept: application/json Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Accept-Encoding: identity Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Connection: close Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Length: 0 Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Content-Type: application/json Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Host: 10.222.0.82 Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Openstack-System-Scope: None Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: User-Agent: python-urllib3/1.26.11 Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Auth-Token: gAAAAABi_nfa_fFAbjkUGtOke8PauLBfDTzI7e3yU9f4IwbqXckBmgDmCyJ8GAOB128PbyLffOoWtQASdtNTCXuatUWH57dvhoReYYRFtrWpfGMfEL6UB1rCyIiGgT00QmK06mfNlCK4d4V5py81B5IPTHVTzOH5NmcxdRNFKG5KI7K9iYol8Xw Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Id: None Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Domain-Name: None Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Identity-Status: Confirmed Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Is-Admin-Project: True Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Id: default Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Domain-Name: Default Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Id: 310d5ca0d33441a4ad074b88dbcb715e Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Project-Name: tempest-TestMinimumBasicScenario-946347483 Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Role: member,reader Aug 18 17:36:32.873857 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Roles: member,reader Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.82:8080", "publicURL": "http://10.222.0.82:8080/v1/AUTH_310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/310d5ca0d33441a4ad074b88dbcb715e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}] Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant: tempest-TestMinimumBasicScenario-946347483 Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Id: 310d5ca0d33441a4ad074b88dbcb715e Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-Tenant-Name: tempest-TestMinimumBasicScenario-946347483 Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User: tempest-TestMinimumBasicScenario-946347483-project Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Id: default Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Domain-Name: Default Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Id: f4f3b121e4c444cb961bf9e1c23bf741 Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: X-User-Name: tempest-TestMinimumBasicScenario-946347483-project Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: method: > Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: exception: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 could not be found. Aug 18 17:36:32.875580 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: action_args: {'id': '4b4cac5b-7983-47a0-a0bb-d338610531e4'} Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: {{(pid=121216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 could not be found. Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:36:32.876613 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 could not be found. Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 could not be found. Aug 18 17:36:32.878173 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: ERROR nova.api.openstack.wsgi Aug 18 17:36:32.879785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: DEBUG nova.api.openstack.wsgi [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Returning 404 to user: Instance 4b4cac5b-7983-47a0-a0bb-d338610531e4 could not be found. {{(pid=121216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:36:32.879785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO nova.api.openstack.requestlog [None req-90368fa1-7270-41f4-95a7-6fe307dbb352 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4" status: 404 len: 111 microversion: 2.1 time: 0.029557 Aug 18 17:36:32.879785 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: [pid: 121216|app: 0|req: 637/1254] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 17:36:32 2022] GET /compute/v2.1/servers/4b4cac5b-7983-47a0-a0bb-d338610531e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:36:32.884843 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: DEBUG nova.api.openstack.wsgi [None req-080c55d0-4d75-46ad-882c-894d3d127a73 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] Calling method '.version_select at 0x7fd1f372a310>' {{(pid=121217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:36:32.963148 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO nova.api.openstack.requestlog [None req-080c55d0-4d75-46ad-882c-894d3d127a73 tempest-TestMinimumBasicScenario-946347483 tempest-TestMinimumBasicScenario-946347483-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-655959014" status: 202 len: 0 microversion: 2.1 time: 0.082873 Aug 18 17:36:32.963718 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: [pid: 121217|app: 0|req: 618/1255] 10.222.0.82 () {58 vars in 1269 bytes} [Thu Aug 18 17:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-655959014 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:37:30.738987 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:37:30.739575 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Thu Aug 18 17:37:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:37:36.672776 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:37:36.673308 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:37:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:38:41.578190 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:38:41.578882 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:39:15.537507 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:39:15.538125 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Thu Aug 18 17:39:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:39:29.128541 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:39:29.129214 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Thu Aug 18 17:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:39:47.169801 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:39:47.170344 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:40:50.747576 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:40:50.748154 dv-cinder-853679-1-iscsi devstack@n-api.service[121216]: Thu Aug 18 17:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:40:56.681596 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:40:56.682150 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:40:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:42:01.587258 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:42:01.588075 dv-cinder-853679-1-iscsi devstack@n-api.service[121217]: Thu Aug 18 17:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!